PROPERTY CF 
TON UNIVERSITY LIBRARY 


EIVED MAY 11 1940 


The 
PSYCHOLOGICAL 


RECORD .... 


EY 


MARCH, 1940 
Vol. III No. 23 


THE INFLUENCE OF THE QUESTION FORM 
UPON THE RESPONSE IN A PUBLIC OPINION POLL 


Apert B. BLANKENSHIP 


le 
SOMMIBAD of: 


THE PRINCIPIA PRESS, INC. 
BLOOMINGTON, INDIANA 


Price of this number, $1.50 

















EDITOR J. R. Kantor, Indiana University 
BUSINESS EDITOR C. M. Louttit, Indiana University 


DEPARTMENTAL EDITORS: 


ABNORMAL Epmunp S. Conk.in, Indiana University 
CHILD Heten Kocn, University of Chicago 
CLINICAL B. M. Castner, Yale University 
COMPARATIVE E. A. Cutter, University of Rochester 
EDUCATIONAL J. G. Peatman, City College of New York 
EXPERIMENTAL B. F. Skinner, University of Minnesota 
MEDICAL Norman Cameron, M. D., Cornell Medical College 
PHYSIOLOGICAL C. F. Scortetp, University of Buffalo 
PSYCHOMETRICS J. P. Guttrorp, University of Nebraska 
SOCIAL Norman C. Meter, University of Iowa 
ASSISTANT EDITOR J. W. Carter, Jr., Indiana University 
aN 


The Principia Press, Inc., has undertaken the publication of this co- 
operative journal to afford authors the opportunity of immediate pub- 
lication at the least possible expense. The present low cost of publication 
and possible future reductions, depend entirely upon the number of 
subscriptions. The subscription price has been made low to induce indi- 
viduals to subscribe. Under the Articles of Incorporation of the Principia 
Press no profit can be made on any of its publications. Therefore an in- 
crease in the number of subscribers will be reflected in reduced costs 
to authors and in increase in the number of pages published annually. 

EpiTor1AL Boarp. The above named board of associate editors have 

ages’ to serve in an active capacity for a period of three years, and 

manuscripts will be submitted to them. 

MANUSCRIPTS may be sent to the appropriate associate editor or to 
Dr. J. R. Kantor. nger papers (30 or more typewritten pages) in the 
above mentioned fields are especially desired. 

Costs. The cost of publication will be $2.00 per page of approximate- 
ly 470 words. The charge for line cut illustrdtions will be $2.00 ard- 
less of size. Special charges will have to be made for complex tabular 
matter and for half-tone or colored illustrations. 

REPRINTS. One hundred copies of each paper will be supplied gratis. 
Additional copies may be purchased in any quantity at a rate which 
will be set when the author is informed of the cost of publication. 

RoyYALtTiges. Fifty per cent of the net income from the sale of indi- 
vidual copies, or from copies sold as part of back volumes, will be 
ited as royalties to the author’s account. Royalties cannot be paid on 
income from subscriptions current in the year of publication. 

SUBSCRIPTIONS. The subscription price is $4.00 per year for an annual 
volume of approximately 500 pages. Individual papers will be sold at 
an advertised price. which will x ae upon the size of the article. 
Foreign subscriptions will be $4.50 

Ree concerning editorial matters should be addressed to 

. J. R. Kantor, or University. Business correspondence should 
be _iddressed to Dr, C. M. Louttit, Principia Press, Inc., Bloomington, 


















THE INFLUENCE OF THE QUESTION FORM 





UPON THE RESPONSE IN A PUBLIC OPINION POLL* 











II. 
III. 
IV. 

V. 


Avpert B. BLANKENSHIP 
Hartwe ti, Jopson & Kispee 


New York City 


CONTENTS 
Introduction and Discussion of Literature.................... 349 
Problem and Miethed ................................................ 357 
iT es el cn oe a 380 
Discussion and Conclusions ..................-----------+---------- 396 
a stake etiisaat Tees hdiiginleninncnsped -cdecaptanaseneniicsoced 403 


*Recommended for publication by Dr. C. M. Louttit, February 27, 1940 














ACKNOWLEDGMENTS 




















This study was made possible by a grant from 
the Psychological Corporation, with which the 
writer was affiliated at the time. Many of the 
staff of the Corporation spent much time in dis- 
f cussion of procedure and critical reading of the 
manuscript. 

Dr. Albert T. Poffenberger, under whose di- 
rection the study was carried out, gave freely of 
his time in discussion of all aspects of the study. 

Dr. Paul F. Lazarsfeld, Director of the Prince- 
ton Radio Research Project, made available his 
card-counting and sorting machine for the classi- 
fication of results. 

Mr. William F. Lovell was invaluable for his 
aid in laying out procedure in the town of Irving- 
ton, and gathering available statistics for the town. 




















1. INTRODUCTION AND DISCUSSION OF 
LITERATURE 


The public opinion poll has become, in a few short years, a 
tremendous influence in our national life. Congressmen and 
other legislators have been forced to take notice of public opinion 
as revealed by the poll technique. Recently, however, many 
criticisms have been leveled against the poll, chief among which 
is the point that the questions are worded in a “leading” or “loaded” 
manner, so that certain results are bound to occur.’ 

This is a serious charge, and if substantiated, might well throw 
doubt on all of the work ever done by the poll-takers. In order to 
determine the degree of importance of the wording of the questions 
used, the present study was undertaken. It should be pointed out, 
however, that regardless of the present results, a similar study 
would have to be made on a nationwide basis, covering many 
national issues, before any conclusions concerning the nationwide 
polls could be drawn. Despite such an obvious limitation, never- 
theless, the present study, made in one town, should be indicative. 

This study was designed to answer the following problems: 


1. Does the question form (i.e. the wording) influence the results 

secured? 

2. What question form (among five used) best predicts election returns? 

3. What question form shows highest consistency of response among 
two samples of voters? 

4. Which form of wording shows least influence of suggestion upon 
those answering? 

5. Which wording produces the fewest “don’t know” responses? (See 
page 389 as to why such a measure might be important.) 

6. Does any effect of wording have a carryover influence upon the 
next question asked? What is such an effect in terms of suggestion, 
consistency, and indecision (the proportion of “don’t know” an- 
swers) ? 

7. What question form may be considered best in the present study? 


Before a detailed discussion of the problem, and the method 
Cf. for example, Spingarn (13), or Studenski (14). 
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used in attacking it, are presented, a background of related work 
performed in the field will aid in understanding the problem and 
seeing how other investigators have attempted to solve it. 

Psychologists have been using formalized questionnaire tech- 
niques since the time of Galton."|) The work that psychologists 
performed in the field of questionnaire investigation was at first 
largely limited to introspective reports of subjects in the laboratory 
situation, such as Galton’s work in the field of imagery. Soon 
the questionnaire method was borrowed by other psychologists 
for use in the field of memory work. From this it was a short 
step to the application of memory questionnaires not only for the 
clinical psychologists to use in the recording of case histories, 
but also to the specific field of testing. Trade tests, for example, 
are almost entirely a matter of questions which require the sub- 
ject to record things he has learned and remembered. 

It is only recently that the questionnaire technique has been 
used in the field of attitude measurement. Thurstone’ was one 
of the earliest to use this approach, but his work was rapidly fol- 
lowed by that of other psychologists. The same method has been 
applied to the measurement of group opinion, such as employee 
morale’ and public opinion in general. 

The use of the attitude questionnaire in the field of public 
opinion was a gradual development that evolved naturally from 
the introspective reports of the psychological laboratory. The 
laboratory subjects reported their feelings and attitudes during 
the course of an introspective experiment. It was not long before 
the “consumer jury” was used,’ wherein the reactions of a par- 


ticular constant group’ of persons are recorded for purposes of 


*F. Galton. Inquires into Human Faculty and Its Development. Lon- 
don: J. M. Dent & Co., 1883. 

*L. I. Thurstone and E. J. Chave. The Measurement of Attitude. Chi- 
cago: Chicago University Press, 1929. 

‘Cf. A. B. Blankenship. The Measurement of Industrial Morale. In The 
Psychology of Industrial Conflict. New York: Society for the Psy- 
chological Study of Social Issues, 1939 (in press). 

° Cf. E. K. Strong. Relative Merits of Advertisements. Arch. Psychol., 
1911, No. 17. 

° A “consumer jury” is a particular group of people who agree to act as 
respondents on a number of subjects and studies, and the sample studied 
always consists of this one identical group. 
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evaluating advertising, or a particular product. This, actually, was 
one of the earliest attempts to measure public opinion. However, 
those in the field of product and advertising evaluation realized 
the limitations of this method, so a wider sample of persons was 
used, and this was the beginning of the now common method of 
measuring public opinion. Closely related to this, of course, is 
the market survey, in which the manufacturer or other agent 
secures the reaction of a large number of people to products, 
policies, advertising, etc. 

Periodic consumer opinion polls, based on careful sampling 
techniques, became more common in the early 1930's, with the 
work of the Psychological Corporation, the American Institute 
of Public Opinion (Gallup), and the Fortune Surveys (Roper). 


The influence of the question form has already been studied 
by psychologists and others. Most of this experimentation has 
been in the field of the memory question, and this work has 
centered in the specific fields of law, education (tests), market 
research, and employment psychology. Probably the earliest rec- 
ord of the influence of the question form in any field was that 
made by Socrates, in his emphasis on the proper wording of ques- 
tions to guide learning. But it is unnecessary for the purposes of 
this paper to summarize the results of the experiments and observa- 
tions on the influence of the question form in the field of educa- 
tion or memory, for such results can scarcely be generalized to ex- 
tend over to the field of attitudes.’ 


7 For references to the influence of the question form in the field of 
law, cf. Burtt, H. E. Legal Psychology. New York: Prentice-Hall, 1931. 
Pp. xiv + 467. Burtt, H. E., & Gaskill, H. V. Suggestibility and the 
form of the question. J. Appl. Psychol., 1932, 16, 358-373. Cady, H. M. 
On the psychology of testimony. Amer. J. Psychol., 1924, 35, 110-112. 
Marston, W. M. Studies in testimony. J. Amer. Inst. Crim. Law, 1924, 15, 
5-31. Morgan, C. S. A study of the psychology of testimony. J. Crim. 
Law & Criminol., 1917, 8, 222-232. Whipple, G. M. Psychology of testi- 
mony and report. Psychol. Bull., 1912, 9, 264-268. 

In the field of education and testing, cf. Franken, A. Aussageversuche 
nach der Methode der Entscheidungs- und Bestimmungsfrage bei Er- 
wachsenen und Kindern. Zsch. f. angew. Psychol., 1912, 6, 174-253. Hurd, - 
A. W. Comparisons of short answer and multiple-choice tests covering 
identical subject content. J. Educ. Res., 1932, 26, 28-30. Kinney, L. B., & 
Eurich, A. C. A summary of investigations comparing different types of 
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In attitude measurement there are primarily three fields all 
closely related to one another—attitude scales, interest question- 
naires, and public opinion polls—in which experimentation on the 
effect of the question form has been attempted. The attitude 
scale, a technique generally applied to measurement of individuals, 
was the first of these to develop, and this was then applied to 
the measurement of interests, also largely with individuals rather 
than with groups. Then came the field of the political and social 
poll, which was different from the attitude scale not only be- 
cause it concerned the measurement of a large number of in- 
dividuals, but also because it concerned the use of a large number 
of interviewers. These three fields are all closely related enough 
so that we shall review work on the question form not from a 
breakdown of the three fields of measurement, but rather accord- 
ing to the type of question variation that has been attempted. 


Mathews (8), using an interest questionnaire which was con- 
structed in two forms, where the order of alternatives was varied, 
observed that with 184 junior high school students, the first item 
in the answer list was checked consistently by 2—39% more students 
than when it was last on the list. This makes it apparent that 
the order of alternatives, though seemingly a small item, must 
affect the validity of the question. Conceivably in some cases where 
the alternatives offered to the respondent were very difficult, the 


tests. Sch. & Soc., 1932, 36, 540-544. Magill, W.H. The influence of the 
form of the item on the validity of achievement tests. J. Educ. Psychol., 
1934, 25, 21-28. Malmud, R. S. The controlled vs. the free completion. 
Amer. J. Psychol., 1925, 36, 401-411. Remmers, H. H., Marschat, L. E., 
Brown, A., & Chapman, I. An experimental study in the relative diffi- 
culty of the true and false, multiple choice, and imcomplete-sentence types 
of examination questions. J. Educ. Psychol., 1923, 14, 367-372. Ruch, 
G. M., & Charles, J. W. A comparison of five types of objective tests in 
elementary psychology. J. Appl. Psychol., 1928, 12, 398-403. Ruch, 
G. M., & Stoddard, G. D. Comparative reliabilities of five types of ob- 
jective examinations. J. Educ. Psychol., 1925, 16, 89-103. Shulson, V., 
& Crawford, C. C. Experimental comparison of true-false and completion 
tests. J. Educ. Psychol., 1928, 19, 580-583. 

In the field of market research cf. Franzen, R. Use of leading ques- 
tions in consumer interviews. Market Research, 1937, 6, No. 3, 19-21. 
Link, H. C. How to prepare questions for consumer research. Printers 
Ink, Jan. 11, 1934, 37-41. Roslow, S., and Blankenship, A. B. Phrasing 
the question in consumer research. J. Appl. Psychol., 1939, 23, 612-622 
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last item would have an advantage because of recency. 

Jenkins (6), in a check-list question’ (developed after a free- 
response trial), asked a group of college students to check the 
outstanding advantages or disadvantages of fraternity life as they 
had encountered it. When the five most frequently checked items 
were omitted, even though space was provided for additional 
answers, the original group that had responded completely dis- 
placed these five items in terms of frequency of response. 

The Fortune surveys (3) add to our knowledge about the 
influence of the completeness of the possibilities offered. In the 
September and October surveys this question was asked: “Which 
of these courses of action comes closest to describing what you 
think the U. S. should do?” Then followed a check-list of 
possibilities. But in October an additional alternative was 
offered—“Refuse to sell actual war munitions but sell the raw 
materials that go into the making of war materials to anyone,” 
and this received 6.4% of the answers! The comparison of re- 
sults for the two months must be made cautiously because of the 
incompleteness of the possibilities offered in the earlier survey. 

If the check-list is exhaustive there appears to be little danger 
in its use, but if the list is incomplete, we must be careful in the 
interpretation of results secured. By rephrasing a question some- 
what and increasing the list of possibilities, Studenski (14) found 
great shifts in response. 

The usefulness of the check-list depends upon the validity and 
completeness of the items, and these can be developed properly 
only through making trial interviews with free response questions 
to determine the required items. 

The Psychological Corporation asked these two questions in 
a gasoline study (12): “What do you think are the most im- 
portant qualities about a gasoline?” (free response). “Which 
of the following qualities of a gasoline do you regard as im- 
portant”? (then followed a list of items). Although there were, 
of course, many more answers given in the case of the check-list, 
the rank order correlation of the results obtained was .93, in- 
dicating very little difference in rank for the answers secured. 
A complete check-list is a good measuring tool for attitudes. We 


8 A list of alternatives offered to the respondent. 
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can see that changing the order and the number of items in the 
check-list can change the response. 

The positive or negative character of the statements may also 
affect the responses secured. Wembridge and Means (15) ex- 
pressed 16 propositions in a positive phrasing and in various forms 
of the negative, and after having a number of groups vote on 
these propositions as worded in a clear positive manner (accord- 
ing to Wembridge and Means), they conducted a revote with the 
negatives. The subjects were all asked to indicate any change in 
attitude in the interim by making a note in the margin. All of 
the negatives, it was concluded, showed a high degree of con- 
fusion. 

Certain words in the question form may arouse the prejudices 
of the person. The work of Menefee (9) is indicative concern- 
ing the effects of emotionally colored words. He drew up 16 
statements, answerable by yes—no. Two statements each applied 
to such categories as “conservatism,” “fascism,” etc. The state- 
ments, without identifying labels, were presented to 742 subjects, 
who, 28 days later, repeated their responses, when each item was 
presented under its appropriate label. Some of the questions 
showed a definite difference in response, while others did not. 
Menefee concluded that some of the terms had an effect upon 
the expressed attitudes. 

Raskin and Cook (10) found that although individuals show 
a high extent of agreement with fascist principles when not labeled 
as such, they will, nevertheless, disagree with the statement that 
“Fascism is the form of government most capable of solving our 
national problems.” However, a person may agree with all of the 
expressed elements of a particular thing and yet not like the thing 
as a whole, if only because not all of the elements have been 
presented to him. 

Hartmann’s work (4) also investigates the effect of appeal to 
prejudice. He used 20 statements so that 10 measured “pure” 
conservatism, and 10 “pure” liberalism. Twenty-two party names, 
as well as the statements, were ranked by 168 voters in a rural 
Pennsylvania community, by means of personal interview. It was 
found that there was a clear and definite distinction between what 
people want and the political channels through which they seek 
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it. The party names color the response, and we may conclude that 
the responses to the individual statements would certainly have 
been different if the party names had been connected to them. 
Again, however, the general term (the party name) stands for 
considerably more than any 20 statements could cover. 


The Psychological Corporation also has an example of how an 
appeal to prejudice can change the response (12). By splitting 
a nationwide sample of respondents into two comparable groups, 
the Corporation was able to ask one question in two ways: “Do 
you like the idea of having Thanksgiving a week earlier this 
year?” “Do you like President Roosevelt’s idea of having Thanks- 


giving a week earlier this year?” “Phe ddition of Roose- 
velt’s name to the question caused an ad 1 5% affirmative 
answers. 


Studenski (14) has found that certain words also may act 
as an appeal to prejudice, and thus affect the responses secured. 
The term “government spending” had such an unfavorable con- 
notation that only 21% of his group of 150 college students 
were in favor of continued government spending when the question 
was phrased: “To increase prosperity, should government spend- 
ing be decreased, continued at the present rate, or increased?” 
The rephrased question: “To increase prosperity should the fol- 
lowing government expenditures be decreased, increased, or con- 
tinued as they are: those for relief; those for work on govern- 
ment projects; those for national defense; those for schools, police, 
etc.?” showed no unqualified opposition to government expendi- 
tures or to increasing them. Of course in this case we have a 
specification of spending, which according to Studenski un- 
doubtedly operates to change the results, but the term “govern- 
ment spending,” he argues, also has an unfavorable connotation. 


Similarl udenski reworded the question: “Should every 
worker be to join a union?” to read: “Is it proper for a 
union to re@uire all ¢ earners in an industrial enterprise to 
join the union (a). y circumstances, (b) when the union 
controls a majority of the employees, (c) when it controls a 
minority of the employees; or is it ingasoper under any circum- 
stances?” Here the proportion entirely opposed to unionization 


dropped from 88.9% in the first wording to 45.0°. in the second. 








—— --~--—— 


creer, 
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Studenski concludes that the first wording suggests compulsory 
enrollment rather than free choice, in addition to the fact that no 
qualification of response was permitted. Several other similar 
examples are presented in Studenski’s work. 


We have ample evidence here that certain words can color the 
question so as to change the response, and in the work of Studenski 
we also have a suggestion that the phrasing or limitation of the 
alternatives offered can further influence the results. Houser (5) 
offers further evidence on this latter point. He asked: “Is the 
service at Blank’s reasonably good?” “Is the service at Blank’s all 
you could expect?” The latter question produced 40% fewer 
affirmative answers,.showing that by making the wording in- 
dicate a higher de f favor toward Blank’s, fewer “yes” an- 
swers can be expected. The Psychological Corporation has evi- 
dence (11) which substantiates this finding. When a question 
was worded: “Are you willing to have an increase in prices with 
the hope that it will bring back prosperity?” 70% of the replies 
were affirmative, while an additional 11°( affirmative replies were 
received when the question was worded: “Are you willing to have 
a reasonable increase in prices with the hope that it will bring 
back prosperity?” 

The addition of the word “you” in a statement has been found 
to influence responses in a simple recall situation,’ but no work 
has been performed in the field of attitude measurement with this 
variable. We have only the unsupported remark of Droba (2) 
that the personal question form (containing the word “you”) is 
more accurate than the impersonal form. 


The summary of work that has already been done upon wording 
of the question in the measurement of attitudes indicates that 
the following variables might well be important in influencing the 
results secured: the order of the alternatives offered, the number of 
the alternatives offered, positive versus negative statements, 
an appeal to prejudice by the use.of particular words which 
color the response, the degree of alternatives offered, and the per- 
sonal versus the impersonal question. 

However, many of these changes involve variations in the 


* Cf. Muscio, op. cit., and Burtt and Gaskill, op. cit. 
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topic of the question. But results secured where the topic 
is a constant, and the form alone is varied, suggest that question 
form itself may be an important variable. For that reason, the pres- 
ent study was undertaken to determine the influence of question 
form upon the responses secured. 

The next chapter will discuss this point somewhat more fully, 
and will, in addition, show specifically what variables were in- 
cluded in the present study, and will outline the general technique 
used in the investigation. 


II. THE METHOD 


As already stated in Chapter I, the purpose of this study was 
to observe and interpret results of a public opinion poll of one 
town, when the form of the questions was varied. Form, as de- 
fined here, refers to minimal changes in wording which do not ac- 
tually involve a change in the subject matter or topic of the ques- 
tion. It was believed that these form variations would be of more 
value than topic variations for purposes of this study, since form 
variations are not commonly assumed to change the results se- 
cured, while topic variations are clearly recognized as a variable 
which can be expected to change the results. 

After a consideration of the possible variables presented in the 
review of the literature, it was decided to limit the variations to 
include six possible comparisons. 

In deciding upon the form variations to be included, only word- 
ings which might be used by polling agencies were included:"’ 

1. The “objective” question. This can be defined as a question contain- 

ing both phrasings—positive and negative—within the question form, 
and not containing the word “you.” 

. The “subjective” question. This is a question containing both 

phrasings within the question itself, and containing the word “you.” 

. The “positive” question, which contains only the positive phrasing 

within che ll 2 el Peer eer a 

For example, such a question as “You do believe in our present na- 
tional administration, don’t you?” would never be asked in a poll in any 
country except those where dictatorships flourish. It should be pointed 


out that all of the terms referring to the question-forms are simply 
arbitrary names assigned by the present writer. 
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. The “negative” question, which contains only the negative phrasing 


within the question wording itself. 


. The check-list question, which contains all possibilities of answer in 


a list read to the respondent immediately following the question. 


. The free-response question, which contains no such list of possible 


responses, but allows the respondent to reply in his own words. 


These variables can be included by asking a particular question in 
five different forms, as was done in the present study: 


a) 
b) 
c) 
d) 
e) 


The objective question 

The subjective question 

The positive objective question 

The positive objective question containing a check-list 
The negative objective question 


A summary of the wordings of the questions asked with each 
of these forms follows: 


N 


10. 


10. 


a) The objective questions 


. Is the present government helping or hurting business? 
. Is the visit of the British King and Queen to this country desirable 


or undesirable? 


. Is it desirable to permit or to prohibit horseracing and parimutuel 


betting in New Jersey? 


. Is it desirable or undesirable to balance the national budget within 


the next four years? 
Should the United States continue or should it break off diplomatic 
relations with Germany? 


b) The subjective questions 


. Do you feel that the present government is helping or hurting 


business? 


. Do you think the visit of the British King and Queen to this 


country is desirable or undesirable? 


. Would you vote for or against the amendment to permit horseracing 


and parimutuel betting in New Jersey? 


. Would you vote for or against the balancing of the national budget 


within the next four years? 
Do you think that the United States should continue or should 
break off diplomatic relations with Germany? 


c) The positive objective questions 


. Is the gresent government helping business? 
. Is the visit of the British King and Queen to this country desirable? 








8. 


10. 
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. Is it desirable to permit horseracing and parimutuel betting in New 


Jersey? 


. Is it desirable to balance the national budget within the next four 


years? 


. Should the United States continue diplomatic relations with 


Germany? 


d) The positive objective question containing a_ check-list 


. Is the present government helping business: Yes, No, or Don’t Know? 
. Is the visit of the British King and Queen to this country desir- 


able: Yes, No, or Don’t Know? 


. Is it desirable to permit horseracing and parimutuel betting in New 


Jersey: Yes, No, or Don’t Know? 


. Is it desirable to balance the national budget within the next four 


years: Yes, No, or Don’t Know? 


- Should the United States continue diplomatic relations with Ger- 


many: Yes, No, or Don’t Know? 
e) The negative objective questions 


. Is the present government hurting business? 
. Is the visit of the British King and Queen to this country undesir- 


able? 


. Is it desirable to prohibit horseracing and parimutuel betting in New 


Jersey? 

Is it undesirable to balance the national budget within the next four 
? 

years? 

Should the United States break off diplomatic relations with Ger- 

many? 


Since all of these questions were concerned with local, national 
and international problems, it was decided to include additional 
questions on similar subjects. It should be stressed that all of the 
question wordings used are essentially similar to those actually 
used on nationwide poll studies, and no “grotesque” forms have 
been included. Five questions were asked in constant form (i.e., 
their form was not varied) : 


l 
3 
5 
7 
9 


. Have you refused to buy either Japanese or German goods? 

. Do you favor a third term for President Roosevelt? 

. Do you believe’ prosperity will increase before the end of 1939? 
. Should the United States cancel foreign war debts? 

. Should the United States supply financial aid to the railroads? 


All of the questions, both the variable and standard forms, 
were decided upon only after a trial survey with 100 individuals 


in Newark, N. J. It might be added at this point that all of 
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the data secured in this study were gathered by means of personal 
interview, which is the common technique in the public opinion 
poll. Interviewers called from door-to-door (the exact procedure 
will be described later) and asked lists of questions provided on 
mimeographed sheets. Before the questions were used for the 
final study, they were clarified in wording where misunderstand- 
ings were evident in the trial interviews. Several questions which 
elicited a high proportion of “don’t know” responses in the trial 
study were eliminated, since it was felt that questions measuring 
a more crystallized opinion might be of greater value for this study. 
In general the simpler questions were placed at the start of the 
questionnaire, since that is the crucial point which determines 
whether or not the person interviewed will continue to talk to the 
interviewer. 

It was originally believed that the standard (unchanging) ques- 
tions would not only act as a standard of comparison of the five 
groups of people to be interviewed, but that these questions might 
also act as “buffers” between the variable questions, since it might 


—_ 


POLL LOLLLO 
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Note: The letters a to e represent variable forms of the question, 
as previously defined and illustrated in the preceding pages. When the 
question form is shown by a number, that indicates that this is a constant 
or standard question in all questionnaires. The actual questions asked can 
be found in the preceding several pages or in the questionnaires included 
in the Appendix. 
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be that there was a carryover from the effect of one variable 
question to another. These standard questions would aid, then, 
in keeping the background of each variable question a constant. 
The questionnaire was therefore constructed in five forms, 
as shown in the Appendix, which may be summarized as above: 
[the different forms being indicated by the letters (a, b, c, etc.), 
with standard questions by the numbers (1, 2, 3, etc.) J. 

The study was made in Irvington, N. J., between June 10 and 
19, 1939. New Jersey was chosen because the state was holding 
an election on June 20 to determine whether or not the state con- 
stitution should be amended to permit horseracing and parimutuel 
betting. The election returns would allow a comparison of the 
results secured on each of the five forms of the question asked to 
determine which showed greatest agreement with the returns, thus 
permitting a measure of validity of the question forms. Irvington 
was selected because it was close to New York City, where the 
writer was located. Furthermore, planning the study for Irving- 
ton, and securing statistics concerning its population were simpli- 
fied by a friend of the writer’s who was a resident of the town. 

The trial survey in Newark showed that there were differences 
between registered and non-registered voters on the horseracing 
and parimutuel betting issue, the registered voters being much 
more definite in their attitudes than the non-registered group. 
Since it was desired to have a total sample of at least 1,500 regis- 
tered voters, a total of 3,000 interviews was secured.'’ For other 
than the horseracing issue, of course, all of the interviews could 
be used. 

A number of experimental controls had to be exercised, to in- 
sure that the intended variables were the only variables. In 
the first place, the sample of persons interviewed had to be rea- 
sonably comparable with the known characteristics of the popula- 
tion of the town. It was also necessary to have the five groups 
of people interviewed with varying forms of the questionnaire as 
nearly equivalent as possible, so that differences resulting on the 
variable questions could be attributed to the form of the question 
rather than to the peculiar characteristics of one or more of the 


The Irvington registration lists indicated that approximately 50% 
of the adults were registered voters. 
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samples. And since the five groups of voters were to be compared 
on the horseracing issue, these five groups also had to be established 
as comparable. 


To establish the equivalence of the groups, therefore, the fol- 
lowing information was secured on every interview (as can be seen 
in the questionnaires included in the Appendix) : 





Do you or your family own an automobile? 

Do you or your family have an automatic refrigerator? 
Do you have your own telephone? 

What is your religion: Hebrew, Protestant, or Catholic? 


(If “Protestant”) Which church? 
In what country were you born? 


Race: White, Black, Brown, Yellow, Indian 
Enter by approximate age: Man Woman... 
Type house: 1 family; 2 family; Apt. 





In addition, it was decided to ask registered voters whether or 
not they planned to vote in this special election so that only this 
group could be used for validation (see page 361 as to why only 
this group was to be used for validation). The date, the street 
and number, the ward and district, and the economic group” 
were also recorded, for purposes to be described later. 

A number of the items mentioned were controlled by instruct- 
ing the interviewers to cover certain specific groups. For example, 
the interviewers were each assigned the number of men and number 
of women to interview daily, and were further instructed how many 
interviews to make in a particular district. Both of these as- 
signments were on the basis of the number of men and women 
present in the 1938 registration lists, and the number of persons 
voting in the 1938 election. Table 1 shows how closely our total 
sample was distributed in proportion to the votes cast in the 


' These groups were divided according to the report of the Brook'ngs 
Institution, 1929, which is commonly used by opinion survey agencies for 
classification of income leve!s. “A” group includes those of approximately 
$5,000 and over; “B” $2,000-5,000; “C” $1,000-2,000; and “D” under 
$1,000. These groups were defined in empirical terms to the interviewers, 
as can be seen by the instruction sheet to interviewers, included in the Ap- 
pendix. - 
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special election in 1939.'" It can be seen that the proportion of 
men and women interviewed is within .2% of the figures secured 
from analysis of the 1938 voting list (Table 2). One other factor 
was controlled by assignment of the interviews—economic group. 
It was predetermined that there were few or no “A” families in 
Irvington, and “B,” “C,” and “D” families were located by dis- 
trict on a map of Irvington, and the probable total of each group, 
district by district, for the entire town was estimated. The total 
number and percent of each economic group interviewed can be 
seen in Table 3. 

The remaining sampling factors were left to chance, the as- 
sumption being that by interviewing every fifth family in a par- 
ticular district, the samples would tend to be representative of the 
population. Tables 4 through 22 indicate further sampling char- 
acteristics of the entire group of persons interviewed. In none 


TABLE 2 


COMPARISON OF PROPORTION OF MEN AND WOMEN 
INTERVIEWED WITH MEN AND WOMEN REGISTERED* 


Total Sample Registered 
No. % No. “ 
Men 1644 54.8 3822 55.0 
Women 1356 45.2 3135 45.0 
Total 3000 100.0 6957 100.0 


*The 1938 registration list was completely tabulated by sex in order 
to secure the number of men and women registered. 


' The standard error of the difference and the critical ratios have not 
been determined between our total sample and the actual figures available, 
primarily because it is not necessary to prove that the sample secured was 
entirely a representative one, for even if our total sample were biased in 
one or more directions, that bias would carry through all forms of the 
interview, and would consequently be a constant for all question forms. 
Another reason why the figures were not computed is the fact that many 
of the figures available for the town are not representative of the situa- 
tion today, having either come from the 1930 Census (which may not 
be true for 1939), or from sources which can not be checked for accuracy. 
As a matter of fact, it is reasonable to suppose that on the majority of the 
sampling information secured, the data revealed in this study are more 
representative of the town than the only figures now available. 
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TABLE 3 
ECONOMIC GROUP OF PERSONS INTERVIEWED* 
Total Sample 
o 


No. X 
B 422 14.1 
. 2492 83.1 
D 86 2.9 
Total 3000 100.1 


*See page 362 for definitions of these groups. 


of these cases is there any attempt to show statistically how close 
the survey figures are to other figures available for the town. There 
are three reasons for this: other figures are not available for all 
sampling characteristics measured; where other figures are avail- 
able they may be only estimates; and even when Census figures 
are available, since these are from 1930, they may not be accurate 
for the present. The proportion of whites and blacks interviewed 
closely follows the proportions given in the 1930 Census (see 
Table 4). Our sample was composed of fewer people within the 
age range of 20-29 than the population at large (Table 5), but 
even if the Census figures are more representative than the 
data obtained in the survey, this does not matter since this 
effect is a constant for all of the interview forms. The countries 
of birth given by those interviewed are representative of those 
listed in the 1930 Census (Table 6). The distribution of religions 


TABLE 4 


COMPARISON OF RACE DATA OBTAINED ON SAMPLE 
WITH CENSUS FIGURES 


Total Sample 1930 Census 

No. % No. % 
White 2998 99.9 56,598 99.8 
Black 2 A 118 2 
Other 17 * 
Total 3000 100.0 56,733 100.0 


*Less than .1°7. 
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TABLE 5 


COMPARISON OF AGE OF PEOPLE INTERVIEWED 


20-29 
30-44 
45-64 
65-up 


Age not given 


Total 


WITH CENSUS FIGURES* 


Total Sample 

No. % 
474 15.8 
1282 42.7 
1071 35.7 
163 5.4 
10 3 


3000 99.9 


1930 Census 
No. Ge 
11,644 30.0 
15,092 38.8 
9,841 25.3 
2,275 5.9 

10 x 
38,862 100.0 


*The Census figures presented here do not include those persons under 
20, since we did not include any persons below voting age in this survey. 


**Less than .1%. 


obtained is given in Table 7, but there are no Census data com- 
parable here, since the 1920 Census was the last that included an 
analysis of religions. 

Tables 8, 9, 10 and 11 are all further indications of economic 


TABLE 6 


COMPARISON OF COUNTRY OF BIRTH OF PEOPLE 
INTERVIEWED WITH 1930 CENSUS FIGURES 


United States 
Germany 
Poland 
Britain* 
Sweden 
Austria 

Russia 

Italy 

Hungary 
Czechoslovakia 
France 

Other 


No Answer 
Total 


*Including England, Scotland, Ireland and Wales. 


Total Sampie 
No. % 


2,281 
232 
80 
79 
11 
49 
90 
51 
31 
13 
5 
46 
32 


3000 


1930 Census 

No. G 
43,477 
4,284 
1,956 
1,629 
135 
568 
1,667 
927 
326 
665 
145 
954 


56,733 
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TABLE 7 
RELIGION OF PERSONS INTERVIEWED* 
Total Sample 


No. 77 

Hebrew 297 9.9 
Catholic 1020 34.0 
Baptist 83 2.8 
Methodist 179 6.0 
Presbyterian 417 13.9 
Episcopal 142 4.7 
Lutheran 251 8.4 
Reformed 119 4.0 
Evangelical 31 1.0 
Other Prot. 63 2.1 
Prot. No Church 243 8.1 
Total Prot. 1528 50.9 
None 132 4.4 
No Answer 23 8 
Total "3000 100.0 


*No recent Census figures were available for comparison. 


level. Table 8 shows that the group we sampled was composed of 
more one and two-family residences, and less apartments than ob- 
tained in the 1930 Census. This may very well be due to a change 
in the type of residence in Irvington during that time. Table 9 
shows the proportion of automatic refrigerator ownership in Irving- 
ton—there are no data available with which to compare the ob- 
tained figures. Table 10 shows the proportion of automobile 
ownership represented in the sample, and the figures available for 
Irvington. In this case the obtained proportion of ownership is 
8% less than the “actual” figure, but the latter contains three 
sources of error. In the first place, the number of registrations 
listed represents the number of licenses issued at the Irvington of- 
fice, not necessarily all of which were for Irvington residences. In 
the second place, the total population figure is only an estimate. 
Finally, the proportion of families owning more than one car is 
not indicated. 

Again, the proportion of telephone ownership obtained on the 
survey (as shown in Table 11) deviates from the “actual” figure, 
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TABLE 8 


COMPARISON OF TYPE OF HOUSE OBTAINED ON 
INTERVIEW WITH 1930 CENSUS FIGURES* 








Total Sample 1930 Census 

No. % No. % 
One Family 1163 38.8 4731 31.3 
Two Family 1207 40.2 5384 35.7 
Apartment 579 19.3 4985 33.0 
No Answer 51 1.7 








Total 3000 100.0 15100 100.0 





*This table is given in terms of the number of families living in each 


type of dwelling. 







TABLE 9 


OWNERSHIP OF AUTOMATIC REFRIGERATORS AMONG 
THOSE INTERVIEWED* 


















Total Sample 
No. % 
Own Automatic Refrig. 1928 64.2 
Don’t Own 1064 35.5 
No Answer 8 3 
Total 3000 100.0 


*There are no actual figures of ownership available with which to com- 
pare these figures. 


TABLE 10 


AUTOMOBILE OWNERSHIP AMONG PERSONS INTER- 
VIEWED COMPARED WITH ACTUAL 
REGISTRATION FIGURES* 


Total Sample Registration 
No. % No. %o 
Own Auto 2072 69.1 12,405 77.1 
Don’t Own 922 30.7 
No Answer 6 2 
Total 3000 100.0 16,006 


*The number of registrations of passenger vehicles in the Irvington 
office is given here, while the total number of families in the town was 
estimated by the Town Clerk of Irvington. 
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TABLE 11 


TELEPHONE OWNERSHIP AMONG PERSONS INTER- 
VIEWED COMPARED WITH ACTUAL 


OWNERSHIP* 
Total Sample Actual Figures 
No. % No. %o 
Own Phone 1363 45.4 40.0 
Don’t Own 1626 54.2 60.0 
No Answer il 4 
Total 3000 100.0 100.0 


*The “actual figures” represent an estimate of residence telephone 
ownership in the town of Irvington, as made by the Bell Telephone of 
New Jersey, telephone company serving that area. No closer figures were 
available. 


TABLE 12 
COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF RACE 


Sample A Sample B Sample C Sample D Sample E CR* P* 

No “% No % No. % No % No. % 
White 600 100.0 600 100.0 599 99.8 600 100.0 599 99.8 1.11 86 
Black 1 > 1 2 1.11 86 


Total 600 100.0 600 100.0 600 100.0 600 100.0 600 100.0 


*In a number of the tables following, the “CR” column refers to the critical 
ratio of the greatest difference of the percentage in the particular row. The “P” 
refers to the probability that this difference is not due to chance. In the above 
table, for example, the critical ratio is secured by dividing the greatest difference 
(.2) by the standard error of the difference (.18). There are 86 chances in 100 
that this difference is not due to chance. When a “CR” is 3.00 or over, “P” is 
shown as 100, but is actually 99 +. 


TABLE 13 
COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF SEX 


Sample A Sample B Sample C Sample D Sample E CR P 

No % No % No. % No &% No. % 
Men 326 «654.3 335 «655.8 318 53.0 317 528 348 58.0 1.81 96 
Women 274 45.7 265 44.2 282 47.0 283 47.2 252 42.0 1.81 96 


Total 600 100.0 600 100.0 600 100.0 600 100.0 600 100.0 
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TABLE 14 
COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF AGE 
Sample A Sample B Sample C Sample 

( io. % 7 


D Sample E CR 


€ C} 


oO. € c c No. /€ No. /€ No. c 


20-29 89 148 90 150 107 178 94 15.7 94 15.7 141 
30-44 267 44.5 242 40.3 251 41.8 244 40.7 278 46.3 2.10 
45-64 211 35.2 229 38.2 210 35.0 222 37.0 199 33.1 1.85 
65-up = oe S&S £2. 3 32.7 62 B.S. 
Not given 3 BS 1 om 1 fe 3 5 2 3 88 


Total 600 100.0 600 100.0 600 100.0 600 100.1 600 99.9 


but this figure is merely an estimate from the N. J. Bell Telephone 
Company. (Irvington and Newark exchanges overlap, so no exact 
figure is available. Moreover, in the telephone company records, 
business and residence phones are not separated.) 

But it can be seen that all of the obtained figures are close to 
the “actual” figures (see page 364 as to why statistical measures are 
not given) available, and hence the sample of persons we inter- 
viewed may be concluded to be a reasonably representative one. 

The next experimental control to be checked upon is the com- 
parability of the five basic questionnaire groups in respect to the 
sampling characteristics. Tables 12 through 22 indicate the com- 
parability of these groups. The “CR” column is the critical ratio 
of the highest percentage obtained on an item to the lowest per- 
centage obtained, while the “P” column is the probability (chances 
in 100) that this is a reliable difference. Obviously, if the highest 
and the lowest percentages obtained are not reliably different, then 
those percentages lying between these extremes cannot be reliably 
different. A critical ratio of 3 or over indicates that the difference 
has over 99 chances in 100 of being reliable. Any critical ratio of 
less than 3 cannot be assumed to represent a reliable difference." 

The proportion of blacks and whites interviewed in each sample 
is not reliably different (Table 12). The proportion of men and 
women interviewed on each sample is not reliably different (Table 
13), while only one age group, 30-44, has a critical ratio of over 
2 (Table 14). 

'' Other methods of establishing comparability, such as chi-square, could 
have been used, but it was felt the computation of critical ratios would be 
adequate for the study. 
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TABLE 17 


COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF 
ECONOMIC GROUP* 


Sample A Sample B Sample C Sample D Sample E CR P 
No. % No % No. % No GG No. Yo 


”m Bt te M2 SS #2 BS MT SS M2 OD TT 
502. 83.7 499 83.2 497 828 495 82.5 499 83.2 .56 71 
19 3.2 16 2.7 18 3.0 17 28 16 27 oOo 


Total 600 100.1 600 100.1 600 100.0 600 100.0 600 100.1 


elel-. 


*See page 362 for definition of these groups. 


TABLE 18 
COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF TYPE HOUSE* 


Sample A Sample B Sample C Sample D Sample E CR P 

No. % No % No % No % No %&% 
1 Family 243 40.5 226 37.7 216 36.0 241 40.2 237 39.5 1.25 89 
2 Family 242 40.3 241 40.2 257 42.8 230 383 237 39.5 1.59 94 
Apartment 111 18.5 121 20.2 116 19.3 117 19.55 114 19.0 .75 77 
No Answer 4 7 Zz 2 ti 1.9 2 Wm HW wm in SS 


Total 600 100.0 600 100.1 600 100.0 600 100.0 600 100.0 


*This table is given in terms of the number of families living in each type of 
dwelling. 


TABLE 19 


COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF AUTOMATIC 
REFRIGERATOR OWNERSHIP 


Sample A Sample B Sample C Sample D Sample E CR P 
No. % No. % No. % No. % No % 
Own 378 63.0 401 66.8 380 63.3 381 63.5 388 64.7 1.38 92 
Don’t Own 221 36.8 197 32.8 218 36.3 218 363 210 35.0 1.45 93 
No Answer 1 a 2 3 2 | 1 = 2 Fe 34 64 f 


Total 600 100.0 600 99.9 600 99.9 600 100.0 600 100.0 


TABLE 20 


COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF 
AUTOMOBILE OWNERSHIP 


Sample A Sample B Sample C Sample D Sample E CR P 
No. % No. % No. % No. % No % 

Own 418 69.7 407 67.8 420 70.0 412 68.7 415 69.2 .82 79 

Don’t Own 180 30.0 193 32.2 178 29.7 188 31.3 183 30.5 .93 83 

No Answer 2 - 2 RK 2 » tae @ 

Total 600 100.0 600 100.0 600 1000 600 100.0 600 100.0 
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TABLE 21 


COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF 
TELEPHONE OWNERSHIP 


Sample A Sample B Sample C Sample D Sample E CR 
No. % No % No % No &% No %&% 
Own 266 44.3 281 46.8 267 44.5 265 44.2 284 47.3 1.08 
Don’t Own 332 55.3 315 52.5 331 55.2 335 55.8 313 52.2 1.25 
No Answer 2 3 4 ae 2 | 3 5 2.06 


Total 600 99.9 600 100.0 600 100.0 600 100.0 600 100.0 


TABLE 22 


COMPARISON OF FIVE BASIC SAMPLES IN TERMS OF 
VOTERS WHO WILL VOTE 


Sample A Sample B Sample C Sample D Sample E CR 
No. % No % No % No & No % 
Voters 
Who Will 336 56.0 368 61.3 331 55.2 344 57.4 347 57.8 2.08 
Vote 


TABLE 23 
COMPARISON OF FIVE SAMPLES OF VOTERS IN TERMS OF RACE 


Sample A Sample B Sample C Sample D Sample E CR P 
No. % No % No % No & No % 

White 336 100.0 368 100.0 330 99.7 344 100.0 346 99.7 1.00 84 

Black 1 3 1 3 100 84 
Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 


Table 15 shows the only case of a critical ratio of over 3 in 
any of the sampling data obtained, and this is for persons born 
in “other” countries. Since the difference in the extremes here is 
one of only 12 cases, it could have but little effect on any of the 
questions asked. 

The religions of the persons interviewed show no statistically 
reliable differences (Table 16). 

There is evidence that all of the samples secured are well within 
the range allowed by chance on the distribution of income levels 
(Table 17). The same thing is true for type of house, ownership 
of automatic refrigerators, and automobile ownership (Tables 18, 
19 and 20). In the case of the ownership of telephones in each one 
of the basic questionnaire groups, the only critical ratio above 2 
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is that for the category “no answer” (Table 21), and, since this 
is due to a difference of only 4 cases between Sample B and 
Sample D, it can scarcely enter into the results secured on any of 


TABLE 24 


COMPARISON OF FIVE SAMPLES OF VOTERS 
IN TERMS OF SEX 


Sample A Sample B Sample C Sample D Sample E 
No. % No. % No &% No & No %& 


Men 216 64.3 223 60.6 205 61.9 204 59.3 217 62.5 

Women 120 35.7 145 39.4 126 38.1 140 40.7. 130 37.5 

Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 
TABLE 25 


COMPARISON OF FIVE SAMPLES OF VOTERS 
IN TERMS OF AGE 


Sample A Sample B Sample C Sample D Sample E 
No. % No. % No % No % No % 


20-29 31 9.2 39 106 41 124 36 105 £41 4118 

30-44 160 47.6 151 41.0 141 42.6 147 42.7 172 49.46 

45-64 121 36.0 157 42.7 135 408 139 404 118 34.0 

65-up 22 6.5 20 «5.4 14 4.2 21 6.1 14 4.0 

Not Given 2 6 1 3 1 3 2 6 

Total 336 99.9 368 100.0 331 100.0 344 100.0 347 100.0 
TABLE 26 


COMPARISON OF FIVE SAMPLES OF VOTERS 
IN TERMS OF COUNTRIES OF BIRTH 


Sample A Sample B Sample Cc Sample D Sample E 


No. % No % No % No % No % 

United States 269 80.1 283 76.9 269 81.3 277 80.5 283 81.6 
Germany 24 7.1 28 7.6 17 5.1 23 6.7 12 3.5 
Poland a 38 4 1.1 4 1.2 3 9 7 2.0 
Britain* 6 18 10 2.7 ? 84 S (“2s Ss 
Sweden 1 a 3 8 1 = 1 R 1 3 
Austria 5 1.5 4 1.1 3 2 5 £5 6 4 
Russia io ee: ee Ee ee ee, eS 9 2.6 
Italy & ¢2 6 16 2 6 e- 23 4 1.2 
Hungary 1 | 3 8 ae ee 3 9 
Czechoslovakia 3 8 1 3 2 6 1 3 
France R 2 6 1 3 
Other 4 1.2 8 2.2 5 1.5 1 3 8 2.3 
No Answer 2 6 4 1. * a2 3 9 & i 

Total 336 100.1 368 100.0 331 99.9 344 100.2 347 100.1 


*Including England, Scotland, Ireland and Wales. 


CR 


1.34 
1.34 


CR 


1.33 
2.32 
2.40 
1.46 
1.46 


CR 


1.55 
2.41 
2.37 
92 
91 
92 
1.36 
1.28 


1.74 
1.43 
2.33 
1.36 


91 
91 


91 
99 
99 
93 
93 
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TABLE 27 


COMPARISON OF FIVE SAMPLES OF VOTERS IN TERMS 
OF RELIGION 


Sample A Sample B Sample C Sample D Sample 
No. % No. % No % No % No. 

Hebrew 29 31 . 7 MS 9.0 

Catholic 104 124 7 108 32.6 108 31.2 
Baptist 13 9 . + : 4.1 
Methodist 18 25 J 26 J 7.3 
Presbyterian 53 61 . 53 . 16.3 
Episcopal 17 21 : 11 ; 5.5 
Lutheran 28 27 : 18 x 8.4 
Reformed 17 12 : 20 
Evangelical 6 2 : 1 
Other Prot. 11 ll . 7 
Prot. No Ch.28 31 : 25 

Total Prot. 191 199 

None 10 11 ‘ 15 

No Answer 2 3 j 4 


w 


_ 


wv 
WD OW me Oo I Ww 00 


ADowwnmnewewanvoon 


Total 336 100.1 368 9 331 


TABLE 28 


COMPARISONS OF FIVE SAMPLES OF VOTERS IN TERMS 
OF ECONOMIC GROUP* 


Sample A Sample B Sample C Sample D Sample E CR 
No. % No. % No. % No % No % 
B 47 140 58 158 51 15.4 53 15.4 56 16.1 .77 
Cc 277 82.4 304 82.6 270 81.6 284 826 281 81.0 .55 
D it 6h 6 is WwW 30 7 2.0 10 2.9 1.65 
Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 


*Definitions of these groups will be found on page 362 of the text. 


TABLE 29 


COMPARISONS OF FIVE SAMPLES OF VOTERS IN TERMS 
OF TYPE HOUSE* 


Sample A Sample B Sample C Sample D Sample E CR 
No. % No. % No % No % No % 

1 Family 147 43.7 152 41.3 129 39.0 150 436 149 42.9 1.24 
2 Family 141 42.0 141 383 141 426 125 36.3 134 386 1.68 
Apartment 47 140 71 193 55 166 64 186 58 16.7 1.89 
No Answer 1 R 4 1 6 18 > i e t 

Total 336 100.0 368 100.0 331 100.0 344 100.0 347 99.9 

*This table is given in terms of the number of families living in each type 
dwelling. 
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TABLE 30 


COMPARISONS OF FIVE SAMPLES OF VOTERS IN TERMS OF 
AUTOMATIC REFRIGERATOR OWNERSHIP 


Sample A Sample 5 Sample C Sample D Sample E CR 

No. % No. % No % No % No % 
Own 218 64.9 258 70.1 213 64.4 223 64.8 235 67.7 1.61 
Don’t 118 35.1 109 296 117 35.3 121 35.2 110 31.7 1.61 
No Answer 1 s 1 3 2 6 1.46 


Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 


TABLE 31 


COMPARISONS OF FIVE SAMPLES OF VOTERS IN TERMS OF 
AUTOMOBILE OWNERSHIP 


Sample 2 Sample e Sample C Sample D Sample E CR 

No. ¢ No. No. % No % No % 
Own 238 70.8 254 69.0 237 71.6 247 71.8 248 71.5 .82 
Don’t 98 29.2 114 310 93 281 97 282 98 282 #84 
No Answer 1 E 1 > 


Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 


TABLE 32 


COMPARISONS OF FIVE SAMPLES OF VOTERS IN TERMS OF 
TELEPHONE OWNERSHIP 


Sample A Sample 5 Sample C Sample D Sample E CR 
No. % No. % No % No % No % 
Own 169 50.3 193 52.4 168 50.8 176 51.2 181 52.1 56 
Don’t 167 49.7 173 47.0 162 48.9 168 488 164 47.3 71 
No Answer z Pe 1 3 2 6 


Total 336 100.0 368 99.9 331 100.0 344 100.0 347 100.0 


the opinion questions. The proportion of voters who intend to vote 
is comparable in the five samples (Table 22). 

There is surely enough evidence to indicate that the five basic 
samples are essentially comparable in the sampling information 
that was obtained on the interview. 

Since the five groups of “voters who intend to vote” are to be 
used later as equivalent groups, it is necessary to show that these 
groups are also comparable in terms of the same sampling charac- 
teristics. Tables 23 through 32 present these comparisons. 

The proportion of whites and blacks in each sample of voters 
is within the difference expected by chance (Table 23). There 
is evidence that the proportion of men and women interviewed is 
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within chance limits (Table 24). In the comparison of the five 
groups in terms of age (Table 25), there are only two classifica- 
tions which have a critical ratio of over 2, while there are only 
three countries of birth which produce a critical ratio of over 2 


(Table 26). 


There are only two critical ratios in comparison of religions of 
the five groups of voters (Table 27), which are over 2. In the 
case of the Baptist group, this is a difference of 10 cases in the ex- 
tremes, and a difference of 6 for the Evangelical group, neither 
of which could cause a large shift in the proportion of answers to 
the racing question. And Tables 28 through 32 show no critical 
ratio at all over 2, which would indicate that the five groups of vot- 
ers are essentially comparable in terms of economic group, type of 
house, automatic refrigerator ownership, automobile ownership, 
and telephone ownership. 

It may be concluded that the five samples of voters are essen- 
tially similar and comparable in the sampling characteristics that 
were measured. 

Ten interviewers each completed 30 interviews daily throughout 
the ten-day period.’ These interviews were distributed in accord- 
ance with the voters and their sex, district by district, the area 
covered by any one interviewer varying from day to day. The inter- 
viewers were instructed to begin each day’s work with Question- 
naire Form A, following with B, C, D and E, in that order, so that 
at the end of the day, each interviewer would have completed 5 
interviews of each form. This technique provided a number of 
experimental controls: 


1. The time element was controlled. If attitudes of any of the ques- 
tions varied from day to day, such a variation should have an equal effect 
on all questionnaire forms, since the same number of each was completed 
day by day. Furthermore, if there were any practise effect in the inter- 
viewing itself, this should be a constant for each form. 

2. The sample for each form, as already shown, was a constant. 

3. The interviewer element was a constant, since, even if one inter- 
viewer was predisposed to secure certain results on particular questions, 
this would be a constant with each form. This element was further con- 


® Actually there were 12 interviewers used, 2 of whom refused to con- 
tinue throughout the period, and had to be replaced. 
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trolled, of course, by giving each interviewer standard instructions, as 
shown in the Appendix. 

4. The context was approximately a constant for each form of the 
questionnaire, not only in the approach of the interviewer, which was a 
standard, defined in the instructions to interviewers (see Appendix), but 
also by the fact that every respondent was interviewed in his home indi- 
vidually. 


As a further precaution that the interviewer element would not 
vitiate the results secured, only experienced interviewers were used 
on the study."” As a check on the honesty of the work of each in- 
terviewer, at least two telephone calls were completed daily through- 
out the period of the study without the knowledge of the inter- 
viewer, with two of the persons he claimed to have interviewed on 
the preceding day. In no case was there any indication that the 
interview had not been completed. 

With the knowledge, then, that the entire sample was a repre- 
sentative one of the town of Irvington, that the samples for the 
five questionnaires were comparable, and that such factors as time 
element, interviewer element, and context had been held approxi- 
mately constant, the results obtained with the five forms of each 
of the variable questions can be presented. 

The questions will be evaluated in four respects: 


1. Validity. As already stated, the validity of each of the question 
forms will be secured by comparing the results from registered voters in- 
tending to vote from each of the five forms with the actual election re 
turns of the town. (on the horseracing and parimutuel question) 

2. Consistency. By means of splitting each group into halves and com- 
paring the results, consistency of group response with each of the five 
variables will be secured for all of the variable questions. 

3. Suggestion. Each of the question forms will be evaluated by co:n- 
paring the proportion of affirmative and negative answers, to determine 
the direction and extent of any suggestion which may operate. 

4. Indecision. The proportion of “don’t know” answers will be com- 
pared for each form of the five variable questions to determine which 
form most frequently gives the highest proportion of “don’t know” 
responses. 


© These interviewers had worked for the Psychological Corporation, 
the American Institute of Public Opinion, The Newark Research Centre, 
or The Princeton Radio Research Project. All of the interviewers were 
thoroughly trained for the present interview, and their technique was 
checked by hav:ng them interview the writer before they began their calls. 
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In general, of course, it can be said that, other things being 
equal, the form of the question having the greatest validity and 
consistency, and the least suggestion and indecision influence, 
would be the best question form. And since the “other things” are 
a constant here (the sample for each question form, the other con- 
stants mentioned in the method, and the content of each question) 
it may be assumed that these criteria are adequate ones for evalua- 
tion of the five question forms we have used in the present study. 


III. RESULTS 


Before any analysis of results classified according to the ques- 
tion form is presented, results without such breakdowns will be 
shown. Table 33" shows the results secured with each of the 
variable questions, while Table 34 shows the results gathered on 
each questionnaire with the standard questions. 

No discussion of these tables will be given at this time, except 
to note that in the case of the variable questions, the differences 
secured with varying forms will be shown in many cases to be 
reliable statistically. In the case of the standard questions, only 
two differences are reliable statistically, but a later breakdown of 
these results will include discussion of this point. 

Results will be summarized under two principal headings: (1) 
results secured from the variable questions, and (2) results secured 
with the standard questions. 


Resutts SecureD From THE VARIABLE QUESTIONS 


As already indicated, these results will be analyzed in four 
respects: (1) validity, (2) consistency, (3) suggestion, and (4) 
indecision. These terms, previously briefly defined, will be en- 
larged upon as the results are presented. 

Validity. The method used for determining the validity of 
each question form was a comparison of the results for each form. 
with the actual election returns in the town of Irvington. It should 
be stressed at this point that validity is the most important of the 
four criteria to be used in evaluating the question forms. Table 


7 See Tables 1 through 5 in the Appendix for statistical reliabilities 
of each of the differences secured. 














= "X93, 9Yy2_-UT ~Paulyap se ‘pasn woz aateuUORsanb ay 03 Burpsor.e paiea sajdwies aya soy ‘ajqea aya ul suUNjo> Aq 
7 03 pasiajas i0u st uoNejndod ay2 yo ajduies sejnonaed aya “saaamoy ‘ajqea siya ul “gq puke ‘q ‘5 ‘g saduieg jo asoy3 
yam paseduiod uvaq aaey y ajdureg jo synsaz ‘ouo siyx Suipacaad sajqea aya yo Aueus ul 3ey2 pay]eraa aq j]IM I], 


TOOT 000¢ OOO! 009 O00! 009 009 6°66 009 6°66 009 ["30L 
£97 008 oSZ ISI OE £81 9<I 8°SZ SSI 8°SZ sot MOBY 300g 
6°S7 922 O'vz br LEZ Chl 891 £97 scl 27 v91 yg 
oLb b7rl 8°0S SOE 8°Sb SLC 917 8b £87 8°9r 182 ae 
OI * 
OOO!  000¢ OOO 009 O00! 009 OCOT 009 OOO! 009 6°66 009 fol 
Sve Se0l LLE 977 O'9€ 917 LEZ (aa 8°0r SbZ eve 902 Mouy 3,u0C] 
Srl ber SZ €cI L7l 92 8 bl 68 Ol £9 38 €¢ aqessepur) 
O'ls Tesl 8°9¢ 17Z e1s¢ 80€ 19 69€ L8b C67 89S Ibe bial 
9° 
0°00T 000€ OOO! 009 OOOT 009 OOOT 009 Too! 009 6°66 009 [OL 
8°07 $79 0°02 0ZI £81 Il C17 671 £07 La €€7 Orl Mouy 3,u0Cq 
Ze 943 v7 lp 8b7 T9E L417 Lee 807 BSE SIZ aqesoavsur) 
14 2 LCP 9¢7 O'0r OvZ €Tb bSZ Lor 8'0r baat 
9° 
0001 O00! 009 O'O0I 009 OOOT 009 TOO 009 O'OOT 009 ]*30L 
817 881 €ll Se 74 Ib 0°02 071 (mas €b72 Mouy 3,u0C] 
86 CLI £01 38 €¢ £01 (4) LS be CL eo  sqesisepur) 
v'89 O'r9 b8E £149 90b £69 SIP CTL $89 base 
b 
6°66 OOO! 009 O'OOT 009 OOOT 009 O'O0T 009 6°66 009 JOL 
See Sa F3 681 eee 002 8°67 641 LSE 8°8E €€¢ Mouy 3,u0q 
2 2 3 000T eve 907 O'9€ 917 Cle 681 OTE 981 See £02 BuranEY 
Ze CHE S07 LOE 81 L8E 7&7 eee 002 22 y91 ~t 
z° 


POLL 


Z. 
Q 
zZ 
a 
(e) 
Y 
J 
ra) 
~ 
a 


% ON % "ON 6 N % ON % “oN 
aanralqo aanalqo 
[230 aanesany wa hh FAIIISOg aanrafqng aansalqo 
*SNOLLSANO ATAVIAVA JO SLINSAY GALVeALNN 
€€ ATAVL 








OOO. OO0OE OOOT 009 OOOT 029 666 009 TOO 009 666 86009 [OL 
Zile 166 TL4Z CEO Oce 86l See €02 T67 SLT ese ZIZ Mouy 3,40C] 
ot bSZ S8z =sOidIZI eczsGSGT €v~ Obl Let =i €7Z vel ON 
cep Sé6Z1 Erp 997 oi) Ge Sip 12 T9p 8 8=LLZ €7p SZ SIX 
GSprospiys ay) 0} pw pprourur{ Kjddns sayp7g paniur) agi pynoys °6 °O 
666 O000€ TOOT 009 O'OOT cod O'O0T 009 O'O0OT 009 O'OOT 009 #39. 
Z91 = =706 TLIC OT O9T 96 SST $6 OZ 8 ZOl LLZT 907 MOuy 2,40C] 
LUL «@8IZ So LEL OC €yL YObb C69 Ib LtL 8k Gel Ibb ON 
GOI 91¢€ 76 cS L6 8S Lei = 88 €<OI 79 $8 €¢ sa 
ésigop spa ud1940f J22UuP?d SayPIg pajuy) 241 pjnoyg *Z ve) 
OOO! O00€ TOOT 009 666 009 O'O0T 009 O'00T 009 O'OOT 009 [30.1 
LZ 8 6€28 ese. sl 867 3=66ZI OTE 98T 8cc SGT €oZ = 7ST MOU 2,40C] 
Gre veel Lee 3972 ev 092 TIb Lez Tob =6LLZ O8b 882 ON 
V'8Z £8 woe 8=—dIST 897 =6«19T ZZ = LZ9T 067 Zi £97 ~=O9T sax 
é6£61 JO pur aq) a4ofag aspasrur ppm Kyjrsadsoud aaajaq nok og “¢ “) 
OOO! OO00€ OOOT 009 666 009 O'OOT 009 O'OOT 009 O'O0T 009 Je30L 
S91 P0¢ O9Il 96 S241 OI Ost gol GSI £6 LOT = OOT MOU 3,40C] 
Z0¢ 77st «670S-~—sCOTOE Scs £1 89r 1872 OS 90€ 87S) «LIE ON 
S7E 16 See £02 €62 Y9ZI Cue ‘HIE cee 102 COE ESI sax 
claaasooy juspisasg sof wisa] p4ty] P 4oav{ nok og ‘¢ ‘€Q 
666 O00€ 666 009 O'OOT 009 O'OOT 009 O'00T 009 666 009 ]30O.L 
¢ 6 i c e I ag I ¢ t Mouy 3,u0C] 
66b Z6bl 87S IE OS 90¢ TOS ~=sC«dTOE C8r 162 OLb 787 JIYIIN] 
6cse 82401 Sree L0Z Gre LOZ 8'°9¢ 17Z O8E 872 sce SIZ tog 
él 8S Ol 9 | Il C7 cI 07 al  ¥ 4 bl ueulsar) 
6OIl SE SOI <9 Ger 42 COI ¢€9 €1lt g9 Srl £48 asauede 
eSpoos upusry 40 asaupdrf 4ayna ng 0} pasnfa. nok JaPzEy *T *C) 
% “N % ON % ON % ON % “ON % ON 
uumnyo") q adureg q ajdureg s ajduesg q 2dureg Vv ajdures 
]e30.], 
SATdWNVS SISVE FAIA NI SNOLLSANO GYVGNV.LS JO NOSIYVdWOD 
be ATAVL 


& 
L 
72) 
Z 
iy 
4 
Z 
< 
J 
a 
a) 
be 
a4 
w 
oe) 
= 
< 





PUBLIC OPINION POLL 


TABLE 35 


RESULTS OF HORSERACING VARIABLE QUESTION WITH FIVE 
FORMS OF QUESTION 
(Based on Total Answers) 


Objective Subjective Positive P.O.C.L. Negative 
jective Objective 
No % No. J No & No % 
Favorable 145 42.2 180 9 166 49.4 39.1 158 47.7 
Unfavorable 148 43.0 133 3 129 38.4 48.0 137 41.4 
Don’t Know 51 14.8 34 : 41 12.2. 47 128 36 109 


Total 344 100.0 347 0 336 100.0 368 99.9 331 100.0 


TABLE 36 


SHOWING ACTUAL ELECTION RETURNS IN IRVINGTON 
ON THE HORSERACING ISSUE 
No. Votes To Votes 


Favorable 3494 50.0 
Unfavorable 3499 50.0 
Total 6993 100.0 


35 shows raw results of the five forms of the horseracing question 
as obtained among five samples of voters who stated at the time 
of the interview that they intended to vote in the special elec- 
tion."* This table shows some interesting differences in the re- 
sponses secured with the five forms. Since only the predictive ac- 
curacy of each question form is being considered at this time, a 
comparison of this table with Table 36 (which shows actual elec- 
tion returns) is very enlightening. To establish a direct measure 
of validity, the “don’t know” responses must first be disregarded, 
leaving only the definite answers; that is, the responses indicating 
a definite attitude either favorable or unfavorable to the horse- 
racing proposal must be the only answers included in this measure. 
Using the total number of definite responses as a basis for com- 


'8 See the description on page 361 as to why the entire sample of persons 
interviewed was not included in the determination of validity. These five 
groups have been shown to be comparable in terms of sampling charac- 
teristics, and as a further check of their comparability, answers to Q. 3, a 
standard question, were compared. Table 9 in the Appendix shows that 
the answers of the five groups of voters on this question did not differ 
more than would be expected by chance. 
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TABLE 37 


RESULTS OF HORSERACING VARIABLE QUESTION WITH FIVE 
FORMS OF QUESTION 


(Based on definite answers) 


Objective Subjective Positive P.O.C.L. Negative 

Objective Objective 

No. Fo No. Yo No. Jo No. J No % 
Favorable 145 49.5 180 57.55 166 56.3 144 44.9 158 53. 
Unfavorable 148 50.5 133 42.5 129 43.7 177. 55.1 137 46.4 


Total Definite 
Answers 293 100.0 313 100.0 295 100.0 321 100.0 295 100.0 


TABLE 38 


SHOWING PREDICTIVE VALIDITY OF VARIABLE FORMS OF HORSE- 
RACING QUESTION AMONG VOTERS WHO WILL VOTE 


(Showing total agreement between vote cast and definite answers) 


Objective Subjective Positive P.O.C.L. Negative 
Objective Objective 
No. Yo No. Go No. Yo No. Jo No. % 
Items Agreeing 290 99.0 266 85.0 258 87.4 288 89.8 274 92.8 


Total Definite 
Answers 293 313 321 


putation, the number and percentage of these replies that agree 
with the election returns may readily be determined.’ This has 
been done in Table 38. Striking differences are apparent in the 
validity of the five forms. The objective form is the most valid 
(99.0%), followed by the negative objective (92.8°,), the posi- 
tive objective with check list (89.8%.), the positive objective 
(87.4%), and the subjective (85.0%). Five of the ten differences 
are statistically reliable as shown in Table 39. The objective valid- 
ity is reliably superior to all of the others; the negative objective 
is statistically superior only to the subjective; while the position 
of the two remaining forms, although probably indicative, is not 
statistically reliable. 

For example, in Table 37, the affirmative replies to the objective 
form are 49.5‘%, a deviation from the election returns of .5‘;. The nega- 
tive replies show the same deviation, so the total form lacks 1% of being 
entirely valid. 


20 Hereafter referred to as the “P.O.C.L.” 
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Consistency. The usual technique in securing a measure of 
consistency of response to a number of unrelated questions such 
as have been used in this study is to secure a number of follow-up 


TABLE 39 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA IN TABLE 38 
Diff. Sigma 
Conditions Compared (in %) Diff. CR 
Objective-Subjective . 2.10 6.67 
Objective-Positive Obj. i 2.02 5.74 
Objective-P.O.C.L. \ 1.79 5.14 
Objective-Negative Obj. ; 1.61 3.85 
Subjective-Positive Obj. j 2.79 86 
Subjective-P.O.C.L. ; 2.63 1.83 
Subjective-Negative Obj. , 2.52 3.09 
Positive Objective-P.O.C.L. / 2.57 93 
Positive Objective-Negative Obj. . 2.45 2.20 
P.O.C.L.-Negative Obj. d 2.26 1.33 


calls, asking the same questions of the identical group of people 
originally interviewed. Consistency is then determined by comput- 
ing the percentage of agreement between the original and follow-up 
response to each question. Jenkins (7) has made a study of con- 
sistency of response to various brand-buying questions. He found 
definite differences in consistency with different subject-matters. 
His results have been fully substantiated, and somewhat extended 
by unpublished data gathered by the Psychological Corporation. 
Since both of these studies point to the fact that different subject- 
matters influence consistency of response, it seems worth while to 
discover whether changes in question forms also affect consistency. 
For this reason, it was felt that a measure of consistency might 
prove very illuminating if secured for each of the variable ques- 
tions. 

The follow-up method of measuring consistency was not used 
in this study, however. Rather, a method was used which involved 
dividing the interviews into odd and even calls immediately after 
they were made so that the two groups to be compared would be 





386 ALBERT B. BLANKENSHIP 


essentially similar. Now it is realized that such a method of 
measuring consistency is not at all comparable to the previously 
described method. The follow-up method is a measure of indi- 
vidual consistency of response, and involves such factors as the 
person’s memory for the original interview and response, actual 
changes in attitudes (or brand-buying behavior, as the case may 
be), and the like. The odd-even method does not depend upoa 
such factors as these, but rather upon the similarity of the dis- 
tribution of answers where the group is broken down into basically 
comparable samples. : 

The formula 6 = \/ % is generally applied to show reliabil- 
ity or unreliability of differences obtained between various samples, 
regardless of question form or content used as long as that ques- 
tion is a constant. A minor purpose of this section of the paper 
is to show that this formula should not be applied indiscriminate- 
ly, but that possibly some correction factor should be determined 
empirically for each question form and content to be com- 
pared,” since we will show that this variation is dependent upon 
the form and content of the question, as well as on the size of the 
sample. Table 40 gives the measure of consistency for each of the 
variable questions in all of its forms. It is at once apparent that 


TABLE 40 


COMPARISON OF CONSISTENCIES FOR VARIABLE 
QUESTIONS IN FIVE BASIC SAMPLES 


(Expressed in terms of number and percentage of indentical 
responses on an odd-even distribution of interviews.) 


Objective Subjective Positive P.O.C.L. Negative 
Objective Objective 

No. % No 7% No. % No % No % 
Q. 276 92.0 278 ; 285 95.0 298 99.3 279 93.0 
Q.4. 275 91.7 287 : 286 95.3 294 98.0 277 92.3 
Q.6. 290 96.7 290 ; 289 96.3 290 96.7 280 93.3 
Q.8. 278 92.7 288 : 295 98.3 296 98.7 289 96.3 
Q.10. 279 93.0 291 97.0 292 97.3 279 93.0 287 95.7 


Total 1398 93.2 1434 95.6 1447 96.5 1457 97.1 1412 94.1 


*t The author has not attempted to arrive at such corrections and is 
himself guilty of using this formula “indiscriminately.” 
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TABLE 41 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA IN TABLE 40 


Diff. Sigma 
Conditions Compared (in %) 
Objective-Subjective 2.4 
Objective-Positive Obj. 3.3 
Objective-P.O.C.L. 3.9 
Objective-Negative Obj. 9 
Subjective-Positive Obj. 9 
Subjective-P.O.C.L. 1.5 
Subjective-Negative Obj. 1.5 
Positive Obj.-P.O.C.L. 6 
Positive Obj.-Negative Obj. 2.4 
P.O.C.L.-Negative Obj. 3.0 


the order of consistency for each question form is approximately 
the same regardless of question content. 


In general, the P.O.C.L. gives the highest consistency (97.1%, 
on the average) , followed by the positive objective (having an aver- 
age of 96.59), the subjective (95.6%), the negative objective 
(94.1%), and the objective (93.2%). Table 41 shows that six 
of the ten consistency differences are statistically reliable. It is 
apparent, for example, that the P.O.CLL. is reliably” more con- 
sistent than three of the other four forms, while the objective is 
reliably inferior to three of the four forms. 

As a matter of interest, the reader might refer to Table 8 in the 
Appendix, which gives consistency figures for the standard social 
questions. This table indicates that there are differences in this 
odd-even consistency measure for varying subject matters, although 
statistical measurements of reliability have not been computed.” 


*2 “Reliably” is here defined as referring to differences with a critical 
ratio of 3.00 or over. 

*3 These consistency figures cannot be compared with the totals shown 
in Table 40 even though the base in each case is 1,500 interviews. It will 
be remembered that the consistencies for the variable questions were secured 
by an addition of the consistencies of five sub-groups in each case, which 
would tend to materially decrease the percentage of agreement for the 
total. 
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Suggestibility. One might assume that in order to measure any 
influence of suggestion on the responses secured, all that need be 
done is to compare the proportion of “yes” and “no” answers in 
each case. However, the matter is not so simple. It is true that 
such a method gives a crude indication of suggestibility, but the 
question immediately arises as to whether one extreme secured (for 
example, the highest proportion of affirmative answers on one of 
the questions) might not actually be the most exact (valid) measure 
of the response. For example, on the horseracing issue, Table 37 
shows us that the highest proportion of favorable answers results 
from the subjective form of the question. Does this of necessity 
indicate that the subjective form here shows the greatest affirma- 
tive suggestion influence? There is no answer to this until the 
validity percentages shown in Table 38 are considered as a start- 
ing point.’ This table shows that the objective question form ‘s 
most nearly the zero point of suggestion since it has such a high 
validity percentage. From a comparison of this table and Table 37, 
it can be seen then, that the subjective form is definitely the most 
affirmatively suggestive question, since the highest proportion of 
“yes” answers results above the zero point (the zero point being 
defined as where little or no suggestion is evident, as shown by high 
validity) and the positive and negative objective are also suggestive 
in the same direction. The P.O.C.L. shows, in the same way, 
negative suggestion influence. 

With this preliminary knowledge, then, the results from all of 
the questions can be considered, as summarized in Table 42. If it 
is assumed that the objective question form is most valid, the only 
assumption possible from available evidence, then the subjective 
and positive objective indicate affirmative suggestion influence, 
while the negative objective and the P.O.C.L. show negative sug- 
gestion. 

However, only two of the ten differences are statistically reliable 
as shown in Table 7 of the Appendix, both of these indicating that 
the negative objective shows negative suggestion. But the order 
of the other items is at least somewhat indicative. 

** We admit, however, that the suggestion results are based on five ques- 


tions, and the validity on only one question but we feel that it is better 
to assume this neutral point rather than merely to guess one. 
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TABLE 42 


SUMMARY OF AFFIRMATIVE AND NEGATIVE ANSWERS TO 
VARIABLE QUESTIONS 


Objective Subjective Positive P.O.C.L. Negative 

Objective Objective 

No % No % No & No % No %& 

Affirmative 1442 68.0 1480 69.5 1549 68.1 1413 65.8 1371 62.3 
Negative 678 320 649 30.5 725 31.9 735 34.2 830 37.7 


Total 2120 100.0 2129 100.0 2274 100.0 2148 100.0 2201 100.0 


We already saw, in Table 33, untreated results for all variable 
questions. In general, the trend for the forms with each content is 
about the same, although exceptions are apparent. 

Since these differences in rank were fairly consistent in the case 
of various contents, it should be expected that the deviations from 
the zero point in suggestion would follow the same order as the 
validity. In the case of the question on horseracing, this is actually 
the case. The negative objective shows 4.1% deviation from the 
zero point (the most valid question, the objective) and is second 
most valid. Results for all of the deviations on this question as 
compared with their validities are shown in Table 43. 

Indecision. Generally speaking, provided the content of a ques- 
tion is a constant, the fewer “don’t know” responses secured, the 
safer is the ground on which the interpretation of public opinion 
questionnaires rests. That is to say, if questionnaire results indicate 


TABLE 43 


SHOWING A COMPARISON OF THE SUGGESTION 
DEVIATION AND THE VALIDITY FOR THE 
HORSERACING ISSUE 


Deviation of Affirmative 
Answers from Zero Point 
of Suggestion 
(in %) 
Objective 0 
Negative Objective +4.1 
P.O.C.L. —4.6 
Positive Objective +6.8 
Subjective +8.0 
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TABLE 44 


SUMMARY OF AFFIRMATIVE, NEGATIVE AND DON’T KNOW 
ANSWERS TO VARIABLE QUESTIONS 


Objective Subjective Positive P.O.C.L. Negative 

Objective Objective 

No “% No % No. Fo No % No & 
Affirmative 1442 48.1 1480 49.3 1549 516 1413 47.1 1371 45.7 
Negative 678 22.6 649 216 725 24.2 735 24.5 830 27.7 
- Don’t Know 880 29.3 871 29.0 726 24.2 852 284 799 26.6 


Total 3000 100.0 3000 99.9 3000 100.0 3000 100.0 3000 100.0 


20% of a group favoring an issue, 20%, opposed, and 60°) un- 
decided, it can be seen that securing definite responses from the 
“don’t know” group might readily change the entire complexion 
of the results. If the question can be so worded that a large propor- 
tion of this undecided group can be made to express an opinion, 
without changing the content or apparent meaning of the question, 
the researcher can therefore be much happier about his results. 
Thus, in the present study, one of the methods used for evaluating 
the question forms was the proportion of “don’t know” answers 
secured with each form. 

Table 44 shows the total of “don’t know” answers for each form 
of the question. It can be seen here that the highest proportion 
of “don’t know” answers (29.3%) is secured with the objective 
form, while the lowest proportion of “don’t know” answers 
(24.2°.) was secured with the positive objective form. 

Only a few of these differences are statistically reliable (Table 
45). It can be seen, for example, that there is a real difference 
between the extremes. We can also say that there is a reliable dif- 
ference between the positive objective and the P.O.C.L. as well as 
between the positive objective and the subjective. 

Consideration of Table 33 will give us an indication of how con- 
sistent this order of “don’t know” responses is within each one of 
the five variable questions. For example, question 2 also has the 
highest proportion of “don’t know” answers with the objective 
form, the least with the positive objective. In question 4 the ob- 
jective form produces the highest proportion of “don’t know” re- 
sponses, while the negative objective has the lowest proportion, 
followed by the positive objective. In question 6 the objective again 
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TABLE 45 
SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 


DIFFERENCES FOR THE DATA IN TABLE 44 


Conditions Compared 
Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Type 
Answer 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 


Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 


Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 


Diff. 


(in %) 


Sigma 
Diff. 
1.21 
1.29 
1.29 
1.29 
1.29 


ee ee 
VMN SPAN A AN AN 


1.57 


has the highest proportion of “don’t know’s,” while the P.O.C.L. 
has the lowest, and in this case, the positive objective is next to the 
highest. In question 8, the subjective produces the highest propor- 
tion of “don’t know” answers and the positive objective the lowest. 
Question 10 shows the highest P.O.C.L. responses, while the nega- 
tive objective is lowest. As would be expected, the subject matter 
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of the question, as well as the question form itself, influences the 
proportion of “don’t know” responses. Now the table just con- 
sidered does not show a great overweighing of responses for any one 
or more question forms within one particular question group. This 
means that the final summary of “don’t know” responses for the 
five forms is probably indicative of a general trend which shows 
up despite varying content with each question form. 


Resutts Securep WITH THE STANDARD QUESTIONS 


Although only 2 of the 170 differences secured for the results 
of the standard questions are reliable statistically (critical ratio of 
3.00 or over), nevertheless since the probabilities of difference of 
the extremes for any one question on different samples is frequent- 
ly rather high (12 of the 17 extreme probabilities shown are above 
90), it was believed that an analysis of these standard questions in 
terms of the variable forms they followed might be enlightening. 
Such an analysis would show any carryover effect that the variable 
forms might have upon the standard questions. 

To determine whether or not there has been such a carryover 
effect, all that need be done is to line up the results of the 
standard questions according to the form of the immediately 
preceding variable question. This has been done for all of the 
measures described in connection with the variable questions except 
validity” (for which there was no measure against which to check 
any of the standard questions). 

Consistency. Table 46 shows the consistency results sum- 
marized for each standard question according to what form of the 
variable question it followed.” We can see, for example, that the 

*° Te might be noted here that even though the untreated results of the 
five standard questions show few reliable differences statistically, and do 
not raise any doubt as to the comparability of the five groups interviewed, 
the variable questions were found to influence the immediately subsequent 
standard questions so much that reliable differences were found for the 
consistency criterion. Although the differences for suggestion and in- 
decision were not reliable, the order was telated to the order of the 
preceding variable results. The differences are clearly due, by their nature, 
to the variable questions. 

** Only four of the standard questions can be analyzed as following 
variable questions, since the first question in the questionnaire was a 
standard question. 
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TABLE 46 


SHOWING THE INFLUENCE OF PRECEDING VARIABLE QUESTION 
UPON CONSISTENCY OF RESPONSE TO STANDARD 
SOCIAL QUESTIONS 


(Expressed in terms of number and percentage of identical responses on an odd- 
even distribution of interviews) 


Objective Subjective Positive P.O.C.L. Negative 
Objective Objective 
No % No “% No. % No % No % 
Identical 
Responses 1162 96.8 1152 96.0 1130 94.2 1155 96.3 1166 97.2 


Note: The greatest difference (of percentages) in this table is between the 
objective and positive objective results, a difference of 2.6. The critical ratio here 
is 4.33, showing that this difference is a reliable one. 


TABLE 47 


SHOWING THE INFLUENCE OF PRECEDING VARIABLE QUESTION 
UPON DEFINITE ANSWERS TO STANDARD SOCIAL QUESTIONS 


Objective Subjective Positive P.O.C.L. Negative 

Objective Objective 

No. % No % No % No &% No &% 
Affirmative 673 36.4 663 36.2 704 37.7 659 36.7 729 39.3 
Negative 1177. 63.6 1171 63.8 1164 62.3 1134 63.3 1126 60.7 


Total 1850 100.0 1834 100.0 1868 100.0 1793 100.0 1855 100.0 


highest consistency resulted following the negative objective form 
(97.2), while the lowest consistency (94.2%) followed the posi- 
tive objective. This difference was found to be a reliable one 
statistically, so that it is apparent that the preceding variable has 
a definite effect upon the consistency of the response to the in- 
terspersed standard questions. A comparison of the order of con- 
sistency for the variable questions (Table 38) shows us that there 
is very little relationship between the order of consistency for the 
two lists. It is apparent that, although the preceding variable ques- 
tion does have some sort of an effect upon consistency, that effect 
is not simply a carryover from the preceding question, as far as 
consistency of response is concerned. 

Suggestibility. Does the preceding variable question influence 
the response to the standard question in such a way as to indicate 
some influence of suggestion? Table 47 shows us that the highest 
proportion of affirmative responses (disregarding the “don’t know” 
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TABLE 48 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 

DIFFERENCES OF THE DATA IN TABLE 47 
Diff. Sigma 

Conditions Compared (in %) Diff. 

Objective Subjective 2 1.58 

Objective-Positive Obj. 1.3 1.58 

Objective-P.O.C.L. ‘ 1.60 

Objective-Negative Obj. ; 1.59 

Subjective-Positive Obj. 

Subjective-P.O.C.L. ‘ ; 

Subjective-Negative Obj. ; 1.60 

Positive Objective-P.O.C.L. 

Positive Obj.-Negative Obj. . : J 

P.O.C.L.-Negative Obj. ' . 1.61 


responses) occurs following the negative objective question form, 
closely followed by the positive objective. The subjective, the ob- 
jective and P.O.C.L. are all about equal in the proportion of 
negative answers, so it would seem that these tend to be negatively 
influenced in terms of suggestion by the preceding variable. Now, 
although Table 48 shows that none of the differences are even close 
to being statistically reliable, it can be seen here that there is an al- 
most inverse relationship between the variable and the standard im- 
mediately following, in terms of the suggestion influence. For exam- 
ple, the negative objective form causes a negative suggestion (the 
greatest) for its own results, while the persons then tend to respond 
in a positive direction (the greatest) on the subsequent question. 
In the variable itself, the P.O.C.L. is the second question in order 
of negative influence, while in the immediately subsequent response, 
it is third. The objective, which is approximately the neutral point 
in the original effect, is evidently causing a negative response in 
the subsequent question. The positive objective, slightly positively 
suggestive as far as its own results are concerned, causes a slightly 
negative response to the subsequent question, while the subjective 
question, most positively suggestive as far as its own results arc 
concerned, is most negatively suggestive in the subsequent ques- 
tion. 

It looks as though there is some sort of reaction of the person 
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TABLE 49 


SHOWING THE INFLUENCE OF PRECEDING VARIABLE QUESTION 
UPON ANSWERS TO STANDARD SOCIAL QUESTIONS 


Objective Subjective Positive P.O.C.L. Negative 

Objective Objective 

No. % No. % No % No % No % 
Affirmative 673 28.1 663 276 704 29.3 659 27.5 729 30.4 
Negative 1177 49.0 1191 49.6 1164 48.5 1134 47.2 1126 46.9 
Don’t Know 550 22.9 546 22.8 532 22.2 607 25.3 545 22.7 


Total 2400 100.0 2400 100.0 2400 100.0 2400 100.0 2400 100.0 


TABLE 50 


SHOWING THE GREATEST DIFFERENCES IN TABLE 49 AND 
THE RELIABILITIES OF THESE DIFFERENCES 
Diff. Sigma 

Conditions Compared (in %) Diff. CR 
Affirmative: 

P.O.C.L.-Negative Obj. 2.9 1.31 2.21 
Negative: 

Subjective-Negative Obj. 2.7 
Don’t Know: 

P.O.C.L.-Positive Obj. 3.1 


interviewed to swing in the opposite direction following a question 
where a response was suggested to him. 

Indecision. Table 49 shows the proportion of “don’t know” 
responses for the standard questions, according to which variable 
form they follow. Even although the greatest difference (between 
the P.O.C.L. and the positive objzctive) is unreliable statistically 
(Table 50), the order of indecision is still interesting. The sub- 
jective shows the greatest proportion of indecision, while the posi- 
tive objective shows least. The positive objective also showed least 
indecision in the actual variable itself, it will be recalled, while the 
subjective was very close to the highest in the proportion of “don’t 
know” responses. Although the agreement is by no means perfect, 
there would seem to be some indication that the proportion of 
“don’t know” responses to a standard question is influenced by the 
proportion of “don’t know”. responses given on the preceding 





396 ALBERT B. BLANKENSHIP 


variable. It is considered fact in poll research that a “don’t know” 
response to one question can cause a tendency for a similar re- 
sponse to a following question. 


IV. DISCUSSION AND CONCLUSIONS 


The first problem that will be taken up in this discussion is 
that of attempting to determine which of the five question forms 
used is the best form in terms of the four criteria considered. It 
has already been pointed out that the objective form was superior 
to all other forms in predictive validity, although it was lowest in 
consistency and showed the highest proportion of indecision. It 
was concluded from the 99.0%; validity that there was practically 
no suggestion operating in the objective form of question. 

Since the objective form has the highest validity (and validity 
is the most important of the four criteria considered) and little 
or no suggestibility, even though the form has lowest consistency 
and highest indecision, it must be concluded that the objective form 
is the best wording that we have used in this particular situation. 
Not only are consistency and indecision the least important of the 
criteria that have been considered, but actually, in terms of prac- 
tical application, the differences within these criteria have little 
significance for the size of differences secured. For example, 
referring again to Table 40, there is very little practical difference 
between the consistency of 93.2%, and 97.1%, the range secured. 
Certainly, in a public opinion poll, all questions having a con- 
sistency within this range (for the number of cases we used) 
would be equally acceptable. If a difference of some 10% had 
resulted in consistency, the criterion would have been a more dif- 
ferentiating one. 

Practically the same thing is true in the case of the criterion of 
indecision. Table 44 indicates that the range of “don’t know” an- 
swers is 24.2% to 29.3%. Although many of the differences were 
reliable statistically, such a small range has little practical signif- 
icance. Again, any question producing “don’t know” responses 
within such a small range would be equally useful for a public 
opinion poll. If differences of some 20% had resulted in this 
criterion, then indecision would have been extremely useful insofar 
as its practical application is concerned. 
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Thus the evaluation of the question forms must rest primarily 
upon the validity and indecision criteria. The objective is more 
valid and less suggestive than any other form. The negative ob- 
jective is next in order of validity (92.8°() although it shows the 
greatest deviation from the zero point of suggestion (5.7°;), and 
this in a negative direction.” 

The P.O.C.L. had the next highest validity (89.807) although 
it showed next highest deviation from the zero point (2.2%) in 
suggestion, being suggestive in a negative direction. The positive 
objective was the fourth most valid form of question (87.4°7), 
despite the fact that it showed least deviation from the zero point 
of suggestion (.1%) in a positive direction. The least valid form 
of question, the subjective (85.0%), was slightly suggestive in the 
affirmative direction (1.5%). 

This definitely indicates that the objective form was the best 
of the five forms used in this particular situation. It is somewhat 
difficult to rank definitely the other forms in an order of “good- 
ness,” but there seems to be little point in doing this at any rate, 
since the objective form turned out to be so superior. 

Although the influence of the preceding variable upon the 
interspersed standard question was not one of the primary pur- 
poses of the study, the results secured here were very enlightening, 
and indicate definite possibilities for further study. Of course 
no measure of validity was available here, so it was impossible to 
determine any effect upon validity which the variables might have 
caused. But, since it has already been shown that there is a rela- 
tionship between validity and suggestion, it would appear fairly 
likely that the middle point in the suggestion list would indicate 
the highest validity. 

From Table 47 it can be seen that the P.O.C.L. form of the 
preceding variable apparently induces least suggestion upon the 
subsequent standard question, and, since the relation between 
suggestion and validity is close, it appears that this may be the most 
valid result. This table also indicates that the standard question 


*7 Tr will be recalled that the validation measure was computed for only 
one question, while the suggestion computation involved use of all variable 
question results. It has been shown that where validation is possible, sug- 
gestion influence is directly and inversely related to it. 
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shows a positive suggestion influence when preceded by the positive 
objective and the negative objective, while some sort of negative 
suggestion influence results when the preceding variable form is the 
objective or subjective. Of course, none of the differences (as 
shown in Table 48) were statistically reliable, but the order of the 
influences of the preceding variables seemed to be reasonable, since 
there was generally an inverse relationship between the directions 
of suggestion in the variable and the immediately following stand- 
ard question. 


Although some of the differences were statistically reliable, the 
order of consistency for the standard questions when classified ac- 
cording to the variable they followed, was not believed to have 
any practical significance, and did not appear to have any rela- 
tionship to the consistencies of the variable questions. On the other 
hand, although none of the differences of the indecision figures 
were statistically reliable, the order was interesting because it corre- 
sponded roughly to the order of indecision for the variable ques- 
tions. 


The conclusions that might be drawn on the basis of the present 
study, with the limitation that all of these conclusions are not meant 
to be generalizations, but are applied only to the population and 
issues studied, are as follows: 


1. In terms of the four criteria—validity, consistency, suggestion, and 
indecision—results of the variable questions were found to be influenced 
by the wording.”* 

2. The objective variable question was found to be the most valid; it 
was reliably different from all of the other forms. Next most valid 
was the negative objective, which was reliably different from two of the 
other four question forms. The P.O.C.L., the positive objective and the 
subjective followed in that order; however, none of the last three were 
reliably different from one another. 

3. For consistency, the order of question forms was found to be: high- 
est, P.O.C.L.; then the positive objective, the subjective, the negative ob- 
jective; and lowest, objective. Although six, of the ten differences were 
reliable statistically, it was concluded that these differences were not large 
enough to be of practical value in determining which question form to use 
in a public opinion poll. 

4. The objective form was found to contain least suggestion. The sub- 


*8 These criteria are defined in preceding chapters. 
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jective and positive objective forms were found to be positively sug- 
gestive, while the negative objective and the P.O.C.L. were found to be 
negatively suggestive. But only two of the ten differences were statistically 
reliable. 

5. The objective question form produced the greatest indecision, fol- 
lowed by the subjective, the P.O.C.L., the negative objective and the posi- 
tive objective. Although three of the ten differences were reliable statis- 
tically, the variations were so small that they would be of no value in 
determining which question form would be best in these terms for a pub- 
lic opinion poll. 

6. As a result of the preceding conclusions, it was decided that in the 
present study, validity and suggestion criteria were the most valuable. In 
these terms the objective proved to be best in this study, although the 
order of goodness for the other questions is not clear. 

7. The variable questions were found to influence the immediately 
subsequent standard questions in terms of consistency, suggestion, and 
indecision. 

8. Although none of the differences secured were reliable, the P.O.C.L. 
variable apparently induced least suggestion upon the immediately fol- 
lowing standard question, since this was the middle item in the sugges- 
tion table. The positive objective and negative objective caused a posi- 
tive suggestion influence upon the immediately following standard ques- 
tion, while the objective and subjective forms were followed by a negative 
suggestion influence. In general, the direction of the variable influence 
induced suggestion in the opposite direction upon the immediately fol- 
lowing standard question. 

9. Highest consistency in the standard questions followed the negative 
objective variable, while the lowest consistency followed the positive ob- 
jective form. Though this difference is reliable statistically, the result 
was believed to have little practical significance because of its small size. 

10. Differences in indecision for standard questions classed accord- 
ing to which variable form they followed proved to be unreliable statis- 
tically, although they showed a rough inclination to follow the order of 
consistency for the preceding variable question. . 


These results should be pertinent for the makers of the nation- 
wide public opinion poll. The study certainly indicates that the 
wording of the question has an influence on the results secured; 
however, much experimentation on this point will be required 
before any extent of generalization can follow. It may even be that 
the effect will vary with the type of subject matter used. 


Now what does our study indicate as far as public opinion sur- 
vey generalizations are concerned? Let us first point out certain 
limitations of the study which might very well prevent generaliza- 
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tion. In the first place, the sample of people on which the survey 
was conducted was a highly selected one, being from only one 
town—lIrvington, N. J. What is true of these people might not 
be true of the population at large, although there is no evidence 
to show that they are peculiar in terms of any characteristic. What- 
ever the shortcomings of such a limited sample may be, the ad- 
vantages it offered in this study were certainly many. For example, 
it was relatively simple to control most of the elements of the 
study. The writer could personally instruct interviewers, rather 
than having them handled through an intermediary. Moreover, 
the sampling controls could be rigidly exercised, since the writer, 
himself, was in personal charge. Since the influences of variable 
questions may vary with different types of persons, the very 
homogeneity of the group studied made us reasonably sure before 
the study was made that any results secured would not be canceled 
out because of great differences in the nature of the sample. And 
of course in working with this one relatively homogeneous group, 
we were on much safer ground in showing that our five basic 
groups were comparable, than we would have been if the five basic 
groups had been selected in terms of a nationwide study. 

But this limited sampling must make us cautious in terms of 
generalization, nevertheless. Even though the number of cases 
is entirely adequate (and indeed considerably larger than is true 
with most psychological investigations) for all of the analyses made, 
this fact does not allow wide generalizations. 

Another limitation of the study was that of necessity a large 
range of subject matters in the questions could not be included. 
This means that again caution is necessary in terms of generalizing 
for all subject matters used in public opinion polls. The study is 
further limited in that only one question—horseracing and pari- 
mutuel betting issue—could be validated. And only five variable 
question forms were used in this study, while even greater differ- 
ences might result when some other variations were introduced. 

Despite all of these limitations, however, the study is enlighten- 
ing. It seems highly likely that the best form of a particular ques- 
tion may vary according to the subject matter of the question, the 
time it is used, the population on which it is used, and the general 
resemblance it has to the issue as it is commonly described (in 
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propaganda, a proposed vote, or from word of mouth) .” 


It would also seem likely that any influence of suggestion in 
the long run would be greatest when the proportion of “don’t 
know” responses was found to be high on a particular issue, since 
there would be more undecided people available for suggestion. 
Unfortunately we have neither the type nor the volume of evidence 
available to settle this issue. Suggestion would also presumably 
be greatest when public opinion was rather evenly divided on the 
issue at hand, and the influence of suggestion would likely decrease 
when the sentiment was quite strong in one direction or the other. 
It would seem, then, that the question form (as far as suggestion 
is concerned) would matter least when public opinion was very 
definitely crystallized on a subject, whereas when there was an 
equal division of opinion, the form would be most important. 


For example, when public opinion is so definitely crystallized 
as on the subject of who is in the right in the European war, the 
question form would probably matter little, if at all. 

What, finally, can be said about the implications of the present 
study? Much more valuable than an attempt to generalize would 
be a suggestion for further research, on the influence of the ques- 
tion form both in terms of its own results and results of subse- 
quently used question forms. A study conducted on a similar basis 
in another community would shed light on whether the same gen- 
eral findings would hold true with another population. A study 
in the same town would determine whether or not the findings were 
to hold true on different issues, and we would also have informa- 
tion on the extent of the influence with questions where opinion 
was heavily and little crystallized. Still another interesting prob- 
lem suggested by this study is to determine the relationship between 
the present method of determining consistency, and the follow-up 
method. Along with this problem is an even more important one 
—the determination of whether the contention put forth on the 


2° It would have been interesting to vary the wording of the horseracing 
issue from a distinctly different to a very similar wording as used in the 
proposed amendment, except that the wording of the amendment was so 
complicated and long that this would have been impossible. If it could 
have been done, the most similar form of the question would presumab!y 
have been found to be most valid in terms of the method used. 
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basis of the present study, that the formula for a standard error 
of a percentage (when applied to questionnaire results) varies 
according to the question form and content, as well as with the 
size of the sample, is a valid one. 

The one thing that this study definitely indicates is the need 
for further research. 
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TABLE | 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA OF QUESTION TWO AS 
GATHERED FROM ENTIRE SAMPLE OF PERSONS 


Type Diff. Sigma 
Conditions Compared Answer (in %) Diff. 


Objective-Sub jective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj. P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 


Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 


Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 


2.65 
2.69 
2.62 
2.66 
2.76 
2.69 
Lae 
2.74 
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TABLE 2 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA OF QUESTION FOUR AS 
GATHERED FROM ENTIRE SAMPLE OF PERSONS 


Diff. 


Conditions Compared 
Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Type 
Answer 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 


Negative 
Negative 
Negative 
Negat've 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 


Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 


(in 


%) 


Sigma 
Diff. 
2.63 
2.67 
2.69 
2.73 
2.62 
2.64 
2.68 
2.68 
2.71 
2.74 


1.42 
1.63 
1.57 
1.87 
1.56 
1.49 
1.81 
1.70 
1.98 
1.93 


2.44 
2.39 
2.46 
2.37 
2.35 
2.42 
2.33 
2.38 
2.28 
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TABLE 3 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA OF QUESTION SIX AS 
GATHERED FROM ENTIRE SAMPLE OF PERSONS 


Type Diff. Sigma 
Conditions Compared Answer (in %) Diff. 


Objective-Subjective Affirmative 3. 2.85 
Objective-Positive Obj. Affirmative 1. 2.84 
Objective-P.O.C.L. Affirmative. 2.83 
Objective-Negative Obj. Affirmative 1. 2.85 
Subjective-Positive Obj. Affirmative 2. 2.86 
Subjective-P.O.C.L. Affirmative 4. 2.84 
Subjective-Negative Obj. Affirmative 2. 2.86 
Positive Obj.-P.O.C.L. Affirmative 2. 2.84 
Positive Obj.-Negative Obj. Affirmative. 2.85 
P.O.C.L.-Negative Obj. Affirmative 


Objective-Sub jective Negative 
Objective-Positive Obj. Negative 
Objective-P.O.C.L. Negative 
Objective-Negative Obj. Negative 
Subjective-Positive Obj. Negative 
Subjective-P.O.C.L. Negative 
Subjective Negative Obj. Negative 
Positive Obj.-P.O.C.L. Negative 
Positive Obj.-Negative Obj. Negative 
P.O.C.L.-Negative Obj. Negative 


Objective-Subjective Don’t Know 
Objective-Positive Obj. Don’t Know 
Objective-P.O.C.L. Don’t Know 
Objective-Negative Obj. Don’t Know 
Subjective-Positive Obj. Don’t Know 
Subjective-P.O.C.L. Don’t Know 
Subjective-Negative Obj. Don’t Know 
Posit've Obj.-P.O.C.L. Don’t Know °' 
Positive Obj.-Negative Obj. Don’t Know 
P.O.C.L.-Negative Obj. Don’t Know 
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TABLE 4 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA OF QUESTION EIGHT AS 
GATHERED FROM THE ENTIRE SAMPLE OF PERSONS 


Type Diff. Sigma 


Conditions Compared 
Objective-Subjective 
Objective-Positive Obj. 
Objective P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective-Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 
Positive Obj.-Negative Obj. 
P.O.C.L.-Negative Obj. 


Objective-Subjective 
Objective-Positive Obj. 
Objective-P.O.C.L. 
Objective Negative Obj. 
Subjective-Positive Obj. 
Subjective-P.O.C.L. 
Subjective-Negative Obj. 
Positive Obj.-P.O.C.L. 


Positive Obj.-Negative Obj. 


P.O.C.L.-Negative Obj. 


Answer 


Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 
Affirmative 


Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 
Negative 


Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 
Don’t Know 


(in %) 


Diff. 
2.87 
2.83 
2.87 
2.82 
2.85 
2.89 
2.84 
2.85 
2.80 
2.84 


1.60 
1.76 
1.69 
2.04 
1.92 
1.85 
2.18 
1.99 
2.30 
2.24 
2.7 

2.60 
2.78 
247 
2.65 
2.82 
2.62 
2.63 


CR 


1.66 
1.92 
7.09 
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TABLE 5 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE DATA OF QUESTION TEN AS 
GATHERED FROM THE ENTIRE SAMPLE OF PERSONS 


Type Diff. Sigma 
Conditions Compared Answer (in %) Diff. CR 
Objective-Subjective Affirmative 1. 2.88 35 
Objective Positive Obj. Affirmative ‘ 2.88 .28 
Objective-P.O.C.L. Affirmative { 2.88 35 
Objective-Negative Obj. Affirmative 4. 2.88 1.39 
Subjective-Positive Obj. Affirmative d 2.88 63 
Subjective-P.O.C.L. Affirmative 2. 2.88 69 
Subjective-Negative Obj. Affirmative 3. 2.89 1.04 
Positive Obj.-P.O.C.L. Affirmative. 2.88 07 
Positive Obj.-Negative Obj. Affirmative 4. 2.88 1.67 
P.O.C.L.-Negative Obj. Affirmative 5. 1.74 


Objective-Subjective Negative 39 
Objective-Positive Obj. Negative : .26 
Objective-P.O.C.L. Negative / : 1.43 
Objective-Negative Obj. Negative : : 1.07 
Subjective-Positive Obj. Negative ; r 63 
Subjective-P.O.C.L. Negative ; , 1.04 
Subjective-Negative Obj. Negative : i 92 
Positive Obj.-P.O.C.L. Negative , r 1.63 
Positive Obj.-Negative Obj. Negative . é 1.58 
P.O.C.L.-Negative Obj. Negative : i 32 


Objective-Subjective Don’t Know . A .00 
Objective-Positive Obj. Don’t Know . : 08 
Obiective-P.O.C.L. Don’t Know 4. : 1.81 
Objective-Negative Obj. Don’t Know . A 24 
Subjective-Positive Obj. Don’t Know . A .08 
Subjective P.O.C.L. Don’t Know 4. ; 1.81 
Subjective-Negative Obj. Don’t Know . : .24 
Positive Obj.-P.O.C.L. Don’t Know 3. ‘ 1.35 
Positive Obj.-Negative Obj. Don’t Know . A 32 
P.O.C.L.-Negat've Obj. Don’t Know 4. 1.67 
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TABLE 6 


SHOWING THE DIFFERENCES AND THE RELIABILITIES 
OF THE DIFFERENCES FOR THE ANSWERS TO THE 
HORSERACING VARIABLE QUESTION AMONG 
FIVE SAMPLES OF VOTERS 


Type Diff. Sigma 
Conditions Compared Answer (in %) Diff. 


Objective-Subjective Affirmative : 3.78 
Objective-Positive Obj. Affirmative : 
Objective-P.O.C.L. Affirmative : 3.68 
Objective-Negative Obj. Affirmative 
Subjective-Positive Obj. Affirmative 
Subjective-P.O.C.L. Affirmative 
Subjective-Negative Obj. Affirmative 

Positive Obj.-P.O.C.L. Affirmative 

Positive Obj.-Negative Obj. Affirmative 
P.O.C.L.-Negative Obj. Affirmative 


Objective-Subjective Negative 
Objective-Positive Obj. Negative 
Objective-P.O.C.L. Negative 
Objective-Negative Obj. Negative 
Subjective-Positive Obj. Negative 
Subjective-P.O.C.L. Negative 
Subjective-Negative Obj. Negative 
Positive-Obj.-P.O.C.L. Negative 
Positive Obj.-Negative Obj. Negative 
P.O.C.L.-Negative Obj. Negative 


Objective-Subjective Don’t Know 
Objective-Positive Obj. Don’t Know 
Objective-P.O.C.L. Don’t Know 
Objective-Negative Obj. Don’t Know 
Subjective-Positive Obj. Don’t Know 
Subjective-P.O.C.L. Don’t Know 
Subjective-Negative Obj. Don’t Know 
Positive Obj.-P.O.C.L. Don’t Know 
Positive Obj.-Negative Obj. | Don’t Know 
P.O.C.L.-Negative Obj. Don’t Know 
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TABLE 7 


SHOWING THE DIFFERENCES AND RELIABILITIES OF THE 
DIFFERENCES FOR THE SUMMARY OF AFFIRM. 
ATIVE AND NEGATIVE ANSWERS 
TO VARIABLE QUESTIONS 


Diff. Sigma 
Conditions Compared (in %) Diff. CR P 
Objective-Sub jective 1.5 1.42 1.06 85 
Objective-Positive Obj. Al 1.41 07 53 
Objective-P.O.C.L. 2.2 1.44 1.53 93 
Objective-Negative Obj. 5.7 1.45 1.40 92 
Subjective-Positive Obj. 1.4 1.40 1.00 84 
Subjective-P.O.C.L. 3.7 1.43 2.59 99 
Subjective-Negative Obj. 7.2 1.44 5.00 100 
Positive Obj.-P.O.C.L. 2.3 1.42 1.62 94 
Positive Obj.-Negative Obj. 5.8 1.42 4.08 100 
P.O.C.L.-Negative Obj. 3.5 1.45 2.41 99 

TABLE 8 


COMPARISON OF CONSISTENCIES FOR STANDARD SOCIAL 
QUESTIONS IN FIVE BASIC SAMPLES 


° Identical Responses 


No. “ 
Q.1 Jap-German 1445 96.3 
Q.3 Third Term 1436 95.7 
Q.5 Prosperity 1426 95.1 
Q.7 Cancel debts 1456 97.1 
Q.9 Financial aid 1447 96.5 


TABLE 9 


COMPARISON OF ONE STANDARD QUESTION (Q.3) IN 
FIVE SAMPLES OF VOTERS 


Q.3. Do you favor a third term for President Roosevelt? 


Sample A Sample B Sample C SampleD SampleE CR P 
No. % No % No % No % No % 

Yes 97 28.9 117 31.8 105 31.7 91 264 110 31.7 1.59 94 

No 192 57.1 207 56.2 177 53.5 204 59.4 192 55.3 1.55 93 

Don’t Know 47 14.0 44 120 49 148 49 14.2 45 13.0 1.08 86 
Total 336 100.0 368 100.0 331 100.0 344 100.0 347 100.0 
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QUESTIONNAIRE FORMS USED 


A 


Have you refused to buy either Japanese 
or German goods? 


Is the present government helping or hurt- 
ing business? 


Do you favor a third term for President 
Roosevelt? 


Do you think the visit of the British King 
and Queen to this country is desirable or 
undesirable? 


Do you believe prosperity will increase be- 
fore the end of 1939? 


Is it desirable to permit horseracing and 
parimutuel betting in New Jersey? 


Should the United States cancel foreign 
war debts? 


Is it desirable to balance the national 
budget within the next four years: Yes, 


No, or Don’t Know? 


Should the United States supply financial 
aid to the railroads? 


Should the United States break off dip- 


lomatic relations with Germany? 


Do you or your family own an automobile? 


Jap l 
Ger oe 
Both 3 
No 4 
Helping 1 
Hurtin 2 
x ... 3 
Yes 1 
No 2 
DK 3 
ee 1 
Und 2 
DK 3 
~~ 5 
No 2 
DK 3 
Yes 1 
No 2 
DK _. 3 
|.” l 
No 2 
DK 3 
Yes - l 
No a 
DK 3 
Yes 1 
No 2 
DK 3 
Yes _... 1 
No 2 
DK 3 
Yes 1 
No 2 
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Do you or your family have an auto- 
matic refrigerator? 


Do you have your own telephone? 
Are you a registered voter? 


(If ‘yes’ to Q.14) Are you going to vote 
in the election on June 20 concerning the 
legalization of horseracing and parimutuel 
betting? 


How many other members of your fam- 
ily are registered voters? (enter number) 


What is your religion: Hebrew, Protestant, 
or Catholic? (If ‘Protestant’ in Q.17) 
Which Church? 


18. In what country were you born? 
co * a * % * 


Race: 1) White. 2) Black 3) Brown 
4) Yellow... 5) Indian - 


Enter by approximate age: Man .. Woman 


Type house: 1 family ...; 2 family (lower 
upper.....); Apt. No... 


Hour of interview _. Date 
Street and Number 


Ward No. District No. 


Inter’s Init. 
Econ. Group: A... BL... C D 


Name 
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B 


Have you refused to buy either Japanese Jap 

or German goods? Ger _. 
Both 
No 


Do you feel that the present government Helping 
is helping or hurting business? Hurting 


DK 


Do you favor a third term for President Yes - 
Roosevelt? No 
DK 


Is the visit of the British King and Queen Yes 
to this country desirable? No . 
DK . 


Do you believe prosperity will increase Yes 
before the end of 1939? No 
DK 


Is it desirable to permit horseracing and Yes _. 
parimutuel betting’ in New Jersey: Yes, No 
No, or Don’t Know? DK ._.. 


Should the United States cancel foreign Yes .. 
war debts? No 
DK 


Is it undesirable to balance the national Yes —. 
budget within the next four years? No 


=... 


Should the United States supply financial Yes 
aid to the railroads? No 
DK 


Should the United States continue or Continue 
should it break off diplomatic relations § Break 
with Germany? DK 


Do you or your family own an automobile? Yes _. 
No 


Do you or your family have an automatic Yes —. 
refrigerator? No 
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Do you have your own telephone? 
Are you a registered voter? 


(If ‘yes’ to Q.14) Are you going to vote 
in the election on June 20 concerning the 
legalization of horseracing and parimutuel 
betting? 


How many other members of your family 
are registered voters? (enter number) 


What is your religion: Hebrew, Protestant, 
or Catholic? (If ‘Protestant’ in Q.17) 
Which Church? eh AE SR one 
In what country were you born? 

ok oe * od * 


Race: 1) White... 2) Black ___. 3) Brown 
4) Yellow... 5) Indian... 


Enter by approximate age: Man ... Woman 


Type house: 1 family __; 2 family (lower _ 
upper ...); Apt. No. 


Hour of interview Date _. 
Street and Number _. 


Ward No. District No. _ Inter’s 
Init. 


Econ. Group: A... oa ta | 


Name 
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C 


Have you refused to buy either Japanese 
or German goods? 


Is the present government helping busi- 
ness? 


Do you favor a third term for President 
Roosevelt? 


Is the visit of the British King and Queen 
to this country desirable: Yes, No, or 
Don’t Know? 


Do you believe prosperity will increase 
before the end of 1939? 


Is it desirable to permit horseracing and 
parimutuel betting in New Jersey? 


Should the United States cancel foreign 
war debts? 


Is it desirable or undesirable to balance the 
national budget within the next four years? 


ee 


Should the United States supply financial 

aid to the railroads? I ads 
Se ae 

Do you think that the United States Continue 


should continue or should break off dip- Break 
lomatic relations with Germany? ae 


Do you or your family own an automobile? Yes - 


Do you or your family have an automatic Yes 
refrigerator? No 





ALBERT B. BLANKENSHIP 


Do you have your own telephone? 
Are you a registered voter? 


(If ‘yes’ to Q.14) Are you going to vote 
in the election on June 20 concerning the 
legalization of horseracing and parimutuel 
betting? 


How many other members of your family 
are registered voters? (enter number) 


What is your religion: Hebrew, Protestant, 
or Catholic? (If ‘Protestant’ in Q.17) 
Which Church? 


In what country were you born? 


* * * *® * #& 


Race: 1) White 2) Black 3) Brown 
4) Yellow... 5) Indian 


Enter by approximate age: Man _. Woman 


Type house: 1 family...; 2 family (lower 
upper....); Apt. No. 


Hour of interview Date 
Street and Number 


Ward No. District No. Inter’s 
Init. 


Econ. Group: A , , ee 


Name 
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D 


Have you refused to buy either Japanese 


or German goods? 


Is the present government helping busi- 
ness: Yes, No, or Don’t Know? 


Do you favor a third term for President 
Roosevelt? 


Is the visit of the British King and Queen 
to this country undesirable? 


DK . 


Do you believe prosperity will increase Yes 
before the end of 1939? No 
DK 


Is it desirable to permit or to prohibit 
horseracing and parimutuel betting in New _— Prohibit 
Jersey? gare 


Should the United States cancel foreign Yes 
war debts? ae 
DK . 


Would you vote for or against the balanc- _—‘ For 2 
ing of the national budget within the next Agst 
four years? 


Should the United States supply financial Yes 


aid to the railroads? 


Should the United States continue diplo- 
matic relations with Germany? 


Do you or your family own an automobile? 


Do you or your family have an automatic 
refrigerator? 





ery 


2 
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13. Do you have your own telephone? Yes 
No 
14. Are you a registered voter? Yes - 
No 
15. (If ‘yes’ to Q.14) Are you going to vote Yes 
in the election on June 20 concerning the No 
legalization of horseracing and parimutuel DK - 
betting? 


16. How many other members of your family 
are registered voters? (enter number) 


17. What is your religion: Hebrew, Protestant, § Heb 
or Catholic? (If ‘Protestant’ in Q.17) Prot 
gL ET TT 

None 

18. In what country were you born? 


ces + + + * 


Race: 1) White 2) Black __. 3) Brown 
4) Yellow. 5) Indian 


Enter by approximate age: Man _.. Woman 


Type house: 1 family ..; 2 family (lower 
upper ..); Apt. No. - 


Hour of interview Date 
Street and Number 


Ward No. District No. Inter’s 


Init. 


Econ. Group: A _..... B C D 


Name 


© 


‘ 
os 


— 


Whe 





13 


14 


15 


16 


17 


18 


19 


20 


21 








N 
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E 


Have you refused to buy either Japanese 
or German goods? 


Is the present government hurting busi- 
ness? 


Do you favor a third term for President 
Roosevelt? 


Is the visit of the British King and Queen 
to this country desirable or undesirable? 


Do you believe prosperity will increase 
before the end of 1939? 


Would you vote for or against the amend- 
ment to permit horseracing and _pari- 
mutuel betting in New Jersey? 


Should the United States cancel foreign 
war debts? 


Is it desirable to balance the national 
budget within the next four years? 


Should the United States supply financial 
aid to the railroads? 


Should the United States continue dip- 
lomatic relations with Germany: Yes, No, 
or Don’t Know? 


Do you or your family own an automobile? 


Do you or your family have an automatic 
refrigerator? 


POLL 


Jap 
Ger 
Both’ 
No 


Ya .. 


No 
DK 


Yes . 


Yes 
No 


WRK WHE WHE WHE WHe Whe Whe 


— No— 





8 


12 
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13. Do you have your own telephone? —. 
No 
14. Are you a registered voter? — 
No 
15. (If ‘yes’ to Q.14) Are you going to vote Yes 
in the election on June 20 concerning the No 
legalization of horseracing and parimutuel DK 
betting? 


16. How many other members of your family 
are registered voters? (enter number) 


17. What is your religion: Hebrew, Protestant, Heb 
or Catholic? (If ‘Protestant’ in Q.17) Prot 
Which Church? ‘ Cath 

None 


18. In what country were you born? 


* % % % * * 


Race: 1) White... 2) Black _. 3) Brown 
4) Yellow. 5) Indian 


Enter by approximate age: Man _. Woman 


Type house: 1 family — ; 2 family (lower 
upper....); Apt. No. 


Hour of interview Date 
Street and Number 


Ward No. District No. Inte-’s 
Init. 


Econ. Group: A. ... B C D 


Name 


—y 


st 


Whore 


l 
= 
3 
4 





13 


15 


16 


17 


18 


19 


20 
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Instruction Sheet—Irvington Study 


Remuneration. These interviews will be paid for at 10c per completed 
call, providing the interviewer completes his 10 full assignments. It is so 
important that each worker remain on the job for 10 days that the 
failure to do so will mean the interviews are worthless. This means that 
interviews must be made daily, rain or shine. 


Read These Instructions and the Questionnaires before leaving your 
supervisor. This will save both of us a lot of headaches! 


Whom, When and Where to Interview. Make interviews only in the 
home. It is absolutely necessary that the exact assignment given be 
carried out in all respects. Only persons 21 years or over are to be 
interviewed. In your assigned territory, call upon every fifth family, that 
is, skip four homes. In other words, if you are in a territory containing 
only 1 family houses, stop at every fifth one. If you pass a 2 family 
residence, that counts as two. If you are in an apartment building, stop 
at every fifth apartment. If you are not able to complete an interview 
at what would be the fifth family, get the next door neighbor; then 
start counting again. If you need a man, and a woman answers the 
door, ask for the man of the house. If no man is available, do not make 
the interview. The procedure may be necessary in order to obtain the 
proper number of interviews with persons of each sex. Do not make in- 
terviews with more than one person at a time. If two persons answer 
together, use the answers of the one who best helps to complete your as- 
signment. No more thah one interview is to be made in one home. 


Economic Status. The sections and streets in which your interviews 
are to be made will be given to you by the supervisor. All of the inter- 
views assigned you are to be in one economic group (note assignment). 
This means that if a residence in your territory does not belong to the 
economic group assigned you, DO NOT make any interviews there. 
Briefly, Class A homes are those in the very best sections, having usually 
2 or more cars, 9 room house (or larger), and servants’ quarters; B Class 
consists of 1 and some 2 family houses, some apartments, 75‘; owning 
cars; C Class includes homes of mechanics, factory workers, etc., mostly 
2 family houses; D Class includes the poorest sections of the city— 
foreign language and colored population, tenements, persons engaged as 
day laborers, service work, carwashers, people on relief, etc. This is almost 
the slum element of the city. 

Legibility. Please use soft black pencil and write legibly. 

Questions must be read word for word to the person interviewed, 
exactly as they appear upon the interview blank. Read the entire ques- 
tion to the interviewee as far as the question mark. You will note that 
certain questions vary somewhat from form to form, so it is absolutely 
necessary to read all questions word for word. 

Recording the Response. Check the proper response in the space pro- 
vided in the right-hand margin. 
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Name. Wherever possible get the name of the person interviewed, 
either from the name on the door, or by asking. This facilitates follow-up 
calls. 

Explanations to Interviewees. Do not explain the meaning of any of 
the questions to the person being interviewed. If the person asks for an 
explanation of a question, simply reread the question. 

Only the questions above the dotted lines are to be asked of the person 
being interviewed. The remaining information is to be filled in by the 
interviewer without asking, simply by observation. 

Don’t Know. If the person interviewed doesn’t know the answer, or 
refuses to answer, check “D.K.” on the question. 

Follow-Up Calls. Be sure to record the sex and age of person inter- 
viewed, type of home, street address, and all other information required at 
the bottom of the blank, since a number of these interviews will be made 
again by another interviewer as a check on accuracy. 

Rotation of Questionnaire Forms. It is absolutely essential that you 
rotate the questionnaire form used. Begin with a particular questionnaire 
form (“A” for example), and when you have completed an interview 
using that form, then make the next interview on the next lettered in- 
terview (“B” for example), until you are ready to start a new series of 
five. Even if you go from one district to another, rotate the interview 
forms in unbroken order. 

Introduction Suggested. “How do you do? We are making a little 
study of how people feel about certain social questions. For example” 
(read Q.1). 

Thank you! 








